-- Logs begin at Mon 2022-06-20 11:32:11 UTC, end at Mon 2022-06-20 12:41:31 UTC. -- Jun 20 12:02:24.812443 dv-cinder-836973-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 12:02:24.821005 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 12:02:24 2022] *** Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: nodename: dv-cinder-836973-4-iscsi Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: machine: x86_64 Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: clock source: unix Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: pcre jit disabled Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: detected number of CPU cores: 4 Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: current working directory: / Jun 20 12:02:24.823021 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: detected binary path: /usr/bin/uwsgi-core Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: your processes number limit is 47680 Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: your memory page size is 4096 bytes Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: detected max file descriptor number: 2048 Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: lock engine: pthread robust mutexes Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: thunder lock: enabled Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 12:02:24.823559 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 12:02:24.867994 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: Python main interpreter initialized at 0x55cf516bd9c0 Jun 20 12:02:24.867994 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: python threads support enabled Jun 20 12:02:24.867994 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: your server socket listen backlog is limited to 100 connections Jun 20 12:02:24.867994 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: your mercy for graceful operations on workers is 90 seconds Jun 20 12:02:24.868363 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 12:02:24.868447 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: *** Operational MODE: preforking *** Jun 20 12:02:24.868705 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: *** uWSGI is running in multiple interpreter mode *** Jun 20 12:02:24.868705 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: spawned uWSGI master process (pid: 80455) Jun 20 12:02:24.868918 dv-cinder-836973-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 20 12:02:24.870211 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: spawned uWSGI worker 1 (pid: 80465, cores: 1) Jun 20 12:02:24.870211 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: spawned uWSGI worker 2 (pid: 80466, cores: 1) Jun 20 12:02:24.871116 dv-cinder-836973-4-iscsi devstack@keystone.service[80455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 12:02:30.383420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:02:30.383420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: from cryptography.utils import int_from_bytes Jun 20 12:02:30.384209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:02:30.384209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: from cryptography.utils import int_from_bytes Jun 20 12:02:30.385449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:02:30.385449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: from cryptography.utils import int_from_bytes Jun 20 12:02:30.385946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 12:02:30.385946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: from cryptography.utils import int_from_bytes Jun 20 12:02:30.433511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:02:30.433688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:02:30.433897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] command line args: [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:02:30.434170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:02:30.434350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ================================================================================ {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:02:30.434513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 12:02:30.434603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] admin_token = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.434793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 12:02:30.434878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] config_dir = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.434986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] command line args: [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 12:02:30.435071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.435180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] config_source = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.435264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 12:02:30.435361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] debug = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.435446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ================================================================================ {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 12:02:30.435639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.435916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] admin_token = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] config_dir = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] config_source = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] debug = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.436999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_config_append = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_dir = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_file = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.437918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_config_append = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_dir = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.438944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_file = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.439924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.440920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] publish_errors = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.441908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442797 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.442935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] standard_threads = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] publish_errors = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] use_journal = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.443985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] use_json = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] use_stderr = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] use_syslog = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] standard_threads = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.444872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.445001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.445141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.445268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.445268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] use_journal = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.445579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.445714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] use_json = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.445867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.445990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] use_stderr = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.446118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.446256 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] use_syslog = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.446397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.446522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 12:02:30.446650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.446732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.446809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.446892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.446965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.447984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.448926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.449943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.450912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.451944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.452919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.453932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.454976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.455860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.456950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.457996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.458935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.459875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460739 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.460977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.461966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.462994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.463966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.464917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.465930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.466056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.466147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.466291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.466369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.466528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.466607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.467998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.468960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.469952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.external = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.470922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.password = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] auth.token = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.471889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.external = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.472854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.password = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] auth.token = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.473829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.474958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.475940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.476951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.477947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.478997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.479981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.480941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.481914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.482073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.482165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.482324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.482449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483140 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.483908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.484916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.485895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.486837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.487966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.488935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.489999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.490932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.491881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.492998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.493980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.494939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.495972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.496909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.497930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.498981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.499944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.500886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.501952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.502999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.503975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] role.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.504939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] role.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.505932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] role.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] role.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.506976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.507953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.508852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.509845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.510964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.511970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.512943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.513094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.513180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.513328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.513406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.513562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.514964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.515931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.516948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.517966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.connection = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.518944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.519974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.connection = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.520920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.521897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80466) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:02:30.522769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.522998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.523251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.523490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.523736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.523970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.524214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.524453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 12:02:30.524625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80465) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 12:02:30.553849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.554085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.554313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.554995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.555232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.555462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.562940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.564297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.591202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.591435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.593238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.593471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.734062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.734402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.783426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.783656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.783916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.784157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.847853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.848938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.849019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.849165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.849386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.849604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.874295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.874514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.874628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.874756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.874843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.874983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.875861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.886639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.887092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.899307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.899485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.899571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.899756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.899844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.899965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80466) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.900835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80465) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 12:02:30.918292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.918502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:02:30.918838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.919041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:02:30.919123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.919308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:02:30.919392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.919567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.919649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.919920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.920013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 12:02:30.920132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.920258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.920545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.920819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.921091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.931105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.931382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.931648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.931925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.932099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.932377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.932649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.932933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.940964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.941955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.944262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.944542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.944826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.945110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.945242 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.945396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.945524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.945657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.945826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.945951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.946939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.947028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.947216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.947490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.947764 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.948034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.973844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.975343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.975455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.975734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.976960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.977243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.980979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.981374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.981654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.982803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.983039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.983327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.989073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.989315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.990614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.990899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.993790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.994100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.994384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.994668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.994944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.995221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.995470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:30.995554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.995747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.995827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.996025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.996308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.996585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.996858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.997127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:30.997396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.015322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.015598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.016796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.017074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.020291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.021838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.023914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.024312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.025467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.025943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.029976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.031573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.033672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.035215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.037345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.037642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.037959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.038248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.038528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.038806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.038890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.039183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.039473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.039758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.040045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.040326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.057821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.058111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.058377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.058654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.059684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.059969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.060241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.061066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.067193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.068910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.069089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.069179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.070851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.071128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.072473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.072772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.073070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.073375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.073713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.074403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.074727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.075060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.075354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.075635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.087519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.087798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.088089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.088372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.089714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.090022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.090123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.090308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.090394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.090604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.090689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.092298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.092594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.092897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.108688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.111113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.112035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.114433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.115346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.117068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.117743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.118745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.119027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.119308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.119500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.121159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.121440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.121731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.127224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.128832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.129878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.131537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.132081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.132383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.132779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.133058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.134794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.135086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.135480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.135763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.142683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.142968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.143259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.145520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.145820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.146110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.151117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80466) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.151396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.151672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.151944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.152213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.152585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.152867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.153139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.153411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.153701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.153999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.154084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80465) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 12:02:31.154550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.154704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.154834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.154953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.155089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80466) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.155232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.155338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.155721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.156012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.156297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.156574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.156860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.157138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.157414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.157706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.158017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80465) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 12:02:31.193689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cf516bd9c0 pid: 80466 (default app) Jun 20 12:02:31.196398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cf516bd9c0 pid: 80465 (default app) Jun 20 12:02:31.197105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62ef8-3153-4cc4-962c-616925a83d24 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:31.197400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62ef8-3153-4cc4-962c-616925a83d24 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:31.197678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62ef8-3153-4cc4-962c-616925a83d24 None None] PATH_INFO: `/v3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:31.202562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Mon Jun 20 12:02:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:39.640560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:39.641155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:39.641155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:39.645490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:39.650863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:39.651285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:39.651424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:39.720757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: INFO dbcounter [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] Registered counter for database keystone Jun 20 12:02:39.741567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG oslo_db.sqlalchemy.engines [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80466) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:02:39.748291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writer thread running {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:02:39.927941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG passlib.handlers.bcrypt [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80466) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 12:02:39.928274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG passlib.handlers.bcrypt [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80466) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 12:02:39.983611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:39.985252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:40.108981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 12:02:40.266733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:40.338081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: INFO dbcounter [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] Registered counter for database keystone Jun 20 12:02:40.357896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG oslo_db.sqlalchemy.engines [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80465) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 12:02:40.364069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writer thread running {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 12:02:40.487115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca800c27-93ce-4ad6-93ab-7a8955e39741 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:40.491383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:40.492045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:40.492334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:40.492612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:40.501076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:40.553085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING keystone.common.rbac_enforcer.enforcer [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 12:02:40.553434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61235-b3bc-43b6-b28a-785220b15f6b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:40.563332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Mon Jun 20 12:02:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:40.569385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:40.584364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9a06-6e77-445f-b508-25b40ca5c3f2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:40.588768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:40.589927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:40.590269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:40.590551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] PATH_INFO: `/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:40.595214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f7b8b3cd4a74f7eb74d84f735aad86f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:40.646640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 12:02:40.646985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936b971-fe21-4b61-b707-124273a56858 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:40.651635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Mon Jun 20 12:02:40 2022] GET /identity/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:42.679972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437052f5-8c49-4fa3-84ce-1dd79c70344e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:42.680483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437052f5-8c49-4fa3-84ce-1dd79c70344e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:42.680565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437052f5-8c49-4fa3-84ce-1dd79c70344e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:42.684755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:02:42.690304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:42.690785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:42.690888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:42.709346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:42.710896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:42.719285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 12:02:42.741710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437052f5-8c49-4fa3-84ce-1dd79c70344e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:42.753790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437052f5-8c49-4fa3-84ce-1dd79c70344e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:42.758046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8ee24-2933-4da6-9676-8037335b874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:42.758678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8ee24-2933-4da6-9676-8037335b874b admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:42.758965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8ee24-2933-4da6-9676-8037335b874b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:42.759257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8ee24-2933-4da6-9676-8037335b874b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:42.767065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8ee24-2933-4da6-9676-8037335b874b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:42.768858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8ee24-2933-4da6-9676-8037335b874b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:42.777593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Mon Jun 20 12:02:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:02:42.783806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:42.792714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d197ce-fdce-449e-9135-a5078e5b0ca2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:42.798012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008fbb2-47e9-4bd9-b9b8-1885b64a1c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:42.798863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fbb2-47e9-4bd9-b9b8-1885b64a1c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:42.799148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fbb2-47e9-4bd9-b9b8-1885b64a1c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:42.799427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008fbb2-47e9-4bd9-b9b8-1885b64a1c36 admin admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:42.800815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008fbb2-47e9-4bd9-b9b8-1885b64a1c36 admin admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:42.802699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008fbb2-47e9-4bd9-b9b8-1885b64a1c36 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:42.804247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Mon Jun 20 12:02:42 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:44.927249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe8df-0107-48d7-a2ca-26535ed8c3f1 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:44.927805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe8df-0107-48d7-a2ca-26535ed8c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:44.927805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fe8df-0107-48d7-a2ca-26535ed8c3f1 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:44.929140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:02:44.934302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:44.934700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:44.936107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:44.953993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:44.955336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:44.972182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351cf23-c437-44f3-aa80-d078eb74e51e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:44.972476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351cf23-c437-44f3-aa80-d078eb74e51e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:44.972776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351cf23-c437-44f3-aa80-d078eb74e51e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:44.974229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:02:44.979071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:44.979360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:44.979641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.020156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG passlib.handlers.bcrypt [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80465) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 12:02:45.020587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG passlib.handlers.bcrypt [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80465) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 12:02:45.050143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:45.067301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:45.068912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:45.075502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.100987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.172019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:02:45.183301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c4e53-683b-4ad5-9b84-43b6e50de2d9 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.194390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.218823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.219615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.219897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.220174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.231672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:02:45.244475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:45.245548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:02:45.246520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:02:45.252651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.297711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8979b-32bf-4fad-9f4f-89d4b5a39b57 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.300030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.335087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.335987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.336266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.336538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.337068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.358031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16817d-ffeb-4d4b-8172-2faa1483c868 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.393999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.394669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.394958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.395248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.396024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:45.396335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.397740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.409557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:45.411741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.413262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.415016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.511236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:02:45.511889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97b06-bbda-4a5e-b973-eca624da592f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.517606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.520333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.547753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.548636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.548923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.549199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.550533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.552025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.553835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:45.558950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.573075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.617816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac50316-9a59-4e75-b51a-1d42e063b63c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.652365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.653156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.653445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.653721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.660453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d7579-b00c-45dc-992b-388d98ab02fe None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.675064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.676561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.697831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.698641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.698925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.699203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.700384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.702028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.703633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:02:45.704163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:45.705099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:45.706035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:02:45.706035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:02:45.706035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:02:45.706035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:02:45.706035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:02:45.709249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.710977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:45.767943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.788938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:45.807728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766b68-5bf4-434f-9e56-4da43734aac8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.813690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c68b51-8208-4364-b9ed-52c33f8fcb6c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:45.840983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.841860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.842405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.842844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.844070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.domain.id=default, user.id=c92fa328437c4093a3eddeda8c856c28) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:45.844376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.845829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d810e-a117-4c5d-b758-4cceb4ce9c47 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.847346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:45.848182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:45.848473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:45.848757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:45.849495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:45.850271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:45.851665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b0e77-ccf7-4747-8f21-39542e7c2a5f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:45.852505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/role_assignments?user.id=c92fa328437c4093a3eddeda8c856c28&scope.domain.id=default&role.id=257fc562d022442fb5494f80168760bb => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:45.871704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:48.255355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd18287-c5f7-403c-a84f-d06784951a24 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.256359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd18287-c5f7-403c-a84f-d06784951a24 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.256864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd18287-c5f7-403c-a84f-d06784951a24 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.258482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:48.264508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77632d-44d0-4ff2-8234-a30f24de1a87 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.265328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77632d-44d0-4ff2-8234-a30f24de1a87 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.265820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77632d-44d0-4ff2-8234-a30f24de1a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.295923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2b77632d-44d0-4ff2-8234-a30f24de1a87 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:48.297477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2b77632d-44d0-4ff2-8234-a30f24de1a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:48.392946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:48.411915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768cf1-18c6-40c6-bd7d-ae2f97d87113 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.412557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768cf1-18c6-40c6-bd7d-ae2f97d87113 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.413037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768cf1-18c6-40c6-bd7d-ae2f97d87113 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.414665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:48.420824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34da39f-aa50-473e-a5a6-2affe3b0da51 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.421395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34da39f-aa50-473e-a5a6-2affe3b0da51 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.421904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34da39f-aa50-473e-a5a6-2affe3b0da51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.424586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768cf1-18c6-40c6-bd7d-ae2f97d87113 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:48.468482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f34da39f-aa50-473e-a5a6-2affe3b0da51 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:48.469705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f34da39f-aa50-473e-a5a6-2affe3b0da51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:48.575256 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:48.637282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:48.666759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768cf1-18c6-40c6-bd7d-ae2f97d87113 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:48.672586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ce72-1194-48d1-b670-9a3aba7fa0df None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.673206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ce72-1194-48d1-b670-9a3aba7fa0df None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.673691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468ce72-1194-48d1-b670-9a3aba7fa0df None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.675878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 13/26] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:48.676966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ce72-1194-48d1-b670-9a3aba7fa0df None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:48.722680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ec134-4e9d-4154-bb2a-b5aca2962d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:48.723854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec134-4e9d-4154-bb2a-b5aca2962d17 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.724342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec134-4e9d-4154-bb2a-b5aca2962d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.724823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ec134-4e9d-4154-bb2a-b5aca2962d17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.739084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ec134-4e9d-4154-bb2a-b5aca2962d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-558ec134-4e9d-4154-bb2a-b5aca2962d17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:02:48.748760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:48.749644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:48.750451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:02:48.752111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 14/27] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:02:48.758018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52043de4-8140-42aa-8999-de8a8c5c12d3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.759116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52043de4-8140-42aa-8999-de8a8c5c12d3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.759704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52043de4-8140-42aa-8999-de8a8c5c12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.768834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:48.783340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-52043de4-8140-42aa-8999-de8a8c5c12d3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:48.787294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-52043de4-8140-42aa-8999-de8a8c5c12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:48.817448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468ce72-1194-48d1-b670-9a3aba7fa0df None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:48.856259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:48.857858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.858159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.858443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.870341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:48.871843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:48.875241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 15/28] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:48.876927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f8d2b-cce2-4141-a7cd-d8a543d1e402 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.877405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f8d2b-cce2-4141-a7cd-d8a543d1e402 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.877891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f8d2b-cce2-4141-a7cd-d8a543d1e402 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.879476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 16/29] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:48.880466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f8d2b-cce2-4141-a7cd-d8a543d1e402 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bfc8bbfe-8b4d-4db6-88aa-eb28e47aae40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:02:48.914619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:48.915492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:48.916305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:02:48.916305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:02:48.916305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:02:48.916305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:02:48.918231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 14/30] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:02:48.919699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:48.920151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:48.920610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:48.938690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:48.940187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:48.964511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.004397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f8d2b-cce2-4141-a7cd-d8a543d1e402 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.014637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 15/31] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:49.015692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.049032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.049715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.050310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.050702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.051540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:49.051924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.053463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.055070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.065744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 17/32] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:49.069959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.151872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85c97b-df40-4f94-8b10-a5532cbd948e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.188268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d85fb-006b-4feb-b06d-0556180d55c5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.192745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.193721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.194293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.194789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.195742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.197571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.214868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.215540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.215830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.216113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.217481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:49.217795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.219303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.238809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 18/33] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:49.239509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.300690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.346572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85c849-9d82-4494-91a5-7fe1936e0daf None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.384335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.385040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.385326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.385653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.386467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.387882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.424610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 16/34] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jun 20 12:02:49 2022] POST /identity/v3/roles => generated 219 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:02:49.426589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.452676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.545186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee9f2c-f4cb-423a-bae5-548493c79902 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.582982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.584263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.584754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.585227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.587247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.589040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.591315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 17/35] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:02:49 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:49.597907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.654982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 19/36] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jun 20 12:02:49 2022] POST /identity/v3/roles => generated 225 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:02:49.663150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.699832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.723600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22922f1-ce3a-4b37-a271-01f2cfd9d608 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.774664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bfc88-0ac9-4524-be14-9fa239197a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.775353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bfc88-0ac9-4524-be14-9fa239197a78 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.776123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bfc88-0ac9-4524-be14-9fa239197a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.776411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bfc88-0ac9-4524-be14-9fa239197a78 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.777156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bfc88-0ac9-4524-be14-9fa239197a78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.780398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bfc88-0ac9-4524-be14-9fa239197a78 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.808626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef95708-2c42-405c-a4ee-c28081369fa3 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:49.835937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:49.853227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ed262-24e1-4e8f-9bf6-50bf1668abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:49.854132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed262-24e1-4e8f-9bf6-50bf1668abbd None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.854469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed262-24e1-4e8f-9bf6-50bf1668abbd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.854760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ed262-24e1-4e8f-9bf6-50bf1668abbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.856179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed262-24e1-4e8f-9bf6-50bf1668abbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:49.858546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ed262-24e1-4e8f-9bf6-50bf1668abbd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:49.860489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 20/37] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:49.862045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75b0af-fbec-464c-b8d8-7d8d640414ee None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.862346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75b0af-fbec-464c-b8d8-7d8d640414ee None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.862629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75b0af-fbec-464c-b8d8-7d8d640414ee None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.864050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 21/38] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:49.868693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75b0af-fbec-464c-b8d8-7d8d640414ee None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:49.908096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 18/39] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:02:49 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:02:49.909884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02998895-f372-4c33-9fba-43523b693830 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:49.910448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02998895-f372-4c33-9fba-43523b693830 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:49.910953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02998895-f372-4c33-9fba-43523b693830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:49.936127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-02998895-f372-4c33-9fba-43523b693830 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:49.938314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-02998895-f372-4c33-9fba-43523b693830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:49.988618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75b0af-fbec-464c-b8d8-7d8d640414ee None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:50.015889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 19/40] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:50.017824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c66ea-b9fa-4b41-a54d-14087e33e240 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:50.018205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c66ea-b9fa-4b41-a54d-14087e33e240 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:50.018562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c66ea-b9fa-4b41-a54d-14087e33e240 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:50.019997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 20/41] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:50.026003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:50.026303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:50.026588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:50.037354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:50.038757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:50.039302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:50.039788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] PATH_INFO: `/v3/domains/default/users/c92fa328437c4093a3eddeda8c856c28/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:50.042507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c92fa328437c4093a3eddeda8c856c28, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:50.044282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:50.047467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:50.048765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:50.116771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:50.122384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 21/42] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:02:50.123614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:50.145480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 22/43] 10.222.0.64 () {58 vars in 1361 bytes} [Mon Jun 20 12:02:49 2022] PUT /identity/v3/domains/default/users/c92fa328437c4093a3eddeda8c856c28/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:02:50.146899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:50.204980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:50.243071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167bc76-05ba-4860-bd93-83e41f3f408f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:50.268219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7de1d-f6f1-42bb-a5db-1df17f66a486 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:50.282293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad307ea-5322-4000-bcaa-70f7a522f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:50.283033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad307ea-5322-4000-bcaa-70f7a522f966 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:50.283320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad307ea-5322-4000-bcaa-70f7a522f966 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:50.283597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad307ea-5322-4000-bcaa-70f7a522f966 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:50.284417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad307ea-5322-4000-bcaa-70f7a522f966 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:50.285878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad307ea-5322-4000-bcaa-70f7a522f966 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:50.309054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:50.310064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:50.310382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:50.310669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:50.311878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:50.313362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:50.315031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 23/44] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:50.320543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:50.347600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jun 20 12:02:50 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:02:50.543025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da1b67-9a05-4b60-b99d-facd6a4db2eb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:50.557375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:50.581375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb2de-a63d-4619-b1cf-9a3cc0575597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:50.582484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb2de-a63d-4619-b1cf-9a3cc0575597 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:50.582953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb2de-a63d-4619-b1cf-9a3cc0575597 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:50.583403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb2de-a63d-4619-b1cf-9a3cc0575597 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:50.584329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb2de-a63d-4619-b1cf-9a3cc0575597 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:50.585987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb2de-a63d-4619-b1cf-9a3cc0575597 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:50.672716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:02:50 2022] POST /identity/v3/projects => generated 312 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:02:52.192380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8d66-627a-49dd-aed5-992f4f6e53b2 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.192886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8d66-627a-49dd-aed5-992f4f6e53b2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.192969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8d66-627a-49dd-aed5-992f4f6e53b2 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.194358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 23/47] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:52.199788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.200201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.200368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.218058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:52.219582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:52.287556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 25/48] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:52.311808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8d66-627a-49dd-aed5-992f4f6e53b2 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:52.371037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:52.418250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8d66-627a-49dd-aed5-992f4f6e53b2 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:52.453162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:52.453985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.454268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.454541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.466011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:02:52.475906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:52.476751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:02:52.477514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 24/49] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:02:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:02:52.483703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:52.576869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:52.583401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea11c74-fe74-41a3-9beb-e69b9cf50fb8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:52.617598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:52.618307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.618594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.618876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.619626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:52.619937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:52.621386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b6567-838d-4caa-956d-2da82b7e6dca None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:52.629545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 26/50] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:02:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:52.635075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:52.710400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe9b2-cbe7-485b-ac84-1a6875878ef6 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.710692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe9b2-cbe7-485b-ac84-1a6875878ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.710978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abe9b2-cbe7-485b-ac84-1a6875878ef6 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.712401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 27/51] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:02:52.717338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.717631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.717951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.735261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:52.735440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127ec69-4fcc-4a64-8a34-8925d434612c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:52.736461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:52.754074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:52.770457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:52.771334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.771623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.771905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.773700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:52.774642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:52.776285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 25/52] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:02:52 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:52.782455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:52.805515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 28/53] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:02:52.829052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:52.918181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:52.934141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca1207-6efe-4fe5-89a5-146e34f7fbf7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:52.971099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:52.971901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:52.972194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:52.972488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:52.973678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:52.975216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:52.976849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 29/54] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:52.982851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:52.988949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1599c-c02e-49e9-bf98-959d8df5011a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:53.023243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:53.024045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:53.024337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:53.024622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:53.025863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:53.027359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:53.028993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 26/55] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:53.035351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:53.084219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36c2b4-81f8-4149-b47f-0d10197b5fe4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:53.093889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:53.119195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10769889-a9d3-467c-a66d-d39f81b7ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:53.119861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769889-a9d3-467c-a66d-d39f81b7ce41 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:53.120151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769889-a9d3-467c-a66d-d39f81b7ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:53.120443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10769889-a9d3-467c-a66d-d39f81b7ce41 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:53.121157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769889-a9d3-467c-a66d-d39f81b7ce41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:53.123337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10769889-a9d3-467c-a66d-d39f81b7ce41 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:53.138945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e0ba-e491-4e6b-a2b9-1b7621d5f5b8 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:53.174132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:53.174731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:53.175023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:53.175309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:53.176139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.domain.id=default, user.id=c92fa328437c4093a3eddeda8c856c28) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:53.176459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:53.178003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07714bcf-4578-45c6-8eed-849d729b35b1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:53.187573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 27/56] 10.222.0.64 () {56 vars in 1322 bytes} [Mon Jun 20 12:02:53 2022] GET /identity/v3/role_assignments?user.id=c92fa328437c4093a3eddeda8c856c28&scope.domain.id=default&role.id=257fc562d022442fb5494f80168760bb => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:53.244665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 30/57] 10.222.0.64 () {60 vars in 1140 bytes} [Mon Jun 20 12:02:52 2022] POST /identity/v3/projects => generated 298 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:02:55.285943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011f81-d81f-427a-90fd-e3ab4fd38281 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:55.286454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011f81-d81f-427a-90fd-e3ab4fd38281 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:55.286542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011f81-d81f-427a-90fd-e3ab4fd38281 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:55.287876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 28/58] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:55.292950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:55.293359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:55.293528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:55.305672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:55.311563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:55.312755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:55.387107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 31/59] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:55.412910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011f81-d81f-427a-90fd-e3ab4fd38281 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:55.512707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011f81-d81f-427a-90fd-e3ab4fd38281 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:55.530715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:55.547373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a924a-98d9-44cc-b41b-e4a8e9f375b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:55.548211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a924a-98d9-44cc-b41b-e4a8e9f375b0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:55.548562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a924a-98d9-44cc-b41b-e4a8e9f375b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:55.548838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a924a-98d9-44cc-b41b-e4a8e9f375b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:55.550035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a924a-98d9-44cc-b41b-e4a8e9f375b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:55.551530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a924a-98d9-44cc-b41b-e4a8e9f375b0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:55.553230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 29/60] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:55.558670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:55.654636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00079d-3b57-487d-a4f9-f731e54f9654 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:55.687279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2895b-d6b2-47e0-a9ea-026add492d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:55.687942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2895b-d6b2-47e0-a9ea-026add492d0f None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:55.688229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2895b-d6b2-47e0-a9ea-026add492d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:55.688505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2895b-d6b2-47e0-a9ea-026add492d0f None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:55.689229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2895b-d6b2-47e0-a9ea-026add492d0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:55.690713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2895b-d6b2-47e0-a9ea-026add492d0f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:55.701822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:55.836220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 32/61] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:02:55 2022] POST /identity/v3/users => generated 275 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:02:59.073163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f44a-3d73-4352-a43f-8b164b3c9a38 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.074061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f44a-3d73-4352-a43f-8b164b3c9a38 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.074553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92f44a-3d73-4352-a43f-8b164b3c9a38 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.076235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 30/62] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:59.081864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.082304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.082470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.110886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:59.112102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:59.166739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e021548-f529-4620-9ca9-fb6cb0e56d40 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.167035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e021548-f529-4620-9ca9-fb6cb0e56d40 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.167308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e021548-f529-4620-9ca9-fb6cb0e56d40 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.168704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:59.189656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f960917-03bb-4cda-967e-2f678fb57bcf None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.189988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f960917-03bb-4cda-967e-2f678fb57bcf None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.190261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f960917-03bb-4cda-967e-2f678fb57bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.211887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 33/64] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:59.216463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1f960917-03bb-4cda-967e-2f678fb57bcf None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:59.217877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1f960917-03bb-4cda-967e-2f678fb57bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:59.254280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.322344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:59.329207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19fc1-175c-4965-b621-363e1c61ec5f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.329510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19fc1-175c-4965-b621-363e1c61ec5f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.329816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c19fc1-175c-4965-b621-363e1c61ec5f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.331381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 33/66] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:02:59.336085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.336379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.336667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.354301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:59.355514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:59.395475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9a220-47ae-4ddc-b19b-e34db3936c3e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:59.422159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:59.434386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:59.435565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.435920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.436207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.445898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 34/67] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:02:59.445898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.460454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:02:59.478703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:59.479617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:02:59.480382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 34/68] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:02:59.486245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.499848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:59.561550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3fcc4-fa96-4656-97b6-9113d9e9e950 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:59.597381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:59.598140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.598429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.598708 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.602716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfe82a-97a3-4e0c-bb60-f270c371f04e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:59.609898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:02:59.617779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:59.618896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:02:59.619675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 35/69] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:02:59.620316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.646694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:59.647360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.647650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.647927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.648683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:59.648991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:59.650439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f705b-9530-48c0-a09a-0ad442b1eb34 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:59.660379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 35/70] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:02:59.661608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20052a-7916-4fb9-bf7c-e135b2d94c17 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.661929 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20052a-7916-4fb9-bf7c-e135b2d94c17 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.662213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20052a-7916-4fb9-bf7c-e135b2d94c17 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.663441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 36/71] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:59.664140 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20052a-7916-4fb9-bf7c-e135b2d94c17 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.712565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:59.722059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9723b0-9fd6-4fd6-8d6f-7b697ef95ea1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:59.728841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:59.756058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab45b9e-d087-4902-a8de-52c2b8fcee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:59.756874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab45b9e-d087-4902-a8de-52c2b8fcee61 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.757167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab45b9e-d087-4902-a8de-52c2b8fcee61 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.757448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab45b9e-d087-4902-a8de-52c2b8fcee61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.767892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab45b9e-d087-4902-a8de-52c2b8fcee61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:02:59.768742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20052a-7916-4fb9-bf7c-e135b2d94c17 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-6ab45b9e-d087-4902-a8de-52c2b8fcee61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:02:59.776359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:02:59.777444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:02:59.778460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 36/72] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:02:59.779732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866956ce-d718-48d8-884f-e7bc42a380a0 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.780360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866956ce-d718-48d8-884f-e7bc42a380a0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.780360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866956ce-d718-48d8-884f-e7bc42a380a0 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.781914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 37/73] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:02:59.782267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866956ce-d718-48d8-884f-e7bc42a380a0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.806854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:59.807524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.807813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.808098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.808861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:02:59.809180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:59.811347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd713c9-e4ed-43cc-af56-d5e5a499f009 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:59.820005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 37/74] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:59.821213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.821507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.821792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.838945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:59.841863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:59.899220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866956ce-d718-48d8-884f-e7bc42a380a0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:02:59.909451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 38/75] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:02:59.910344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:02:59.939764 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e66054-55a3-4f45-9d89-85d401d2e251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:02:59.940640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e66054-55a3-4f45-9d89-85d401d2e251 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.940926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e66054-55a3-4f45-9d89-85d401d2e251 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.941202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e66054-55a3-4f45-9d89-85d401d2e251 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.946766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:02:59.956583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e66054-55a3-4f45-9d89-85d401d2e251 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:02:59.958107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e66054-55a3-4f45-9d89-85d401d2e251 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:02:59.959868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:02:59.961070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:02:59.961332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:02:59.961614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:02:59.978509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:02:59.979707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:02:59.996968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.014047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a35c6-d035-42ac-bbaf-d7dc6e289d86 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.048676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 39/77] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:00.048906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.049510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.049618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.049931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.050220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.050974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:00.051289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.052700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.065862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:02:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:00.065862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.158280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e173b14-e979-4574-90d4-4a418cb9370d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.165206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.168916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3897d-42cd-4fde-93d2-667b199090a3 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.199022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.199892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.200189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.200884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.202104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.203572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.204390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.205192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.205332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:00.206121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.210028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.210332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.221376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:00.229778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:00.230719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:00.232080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:00.233379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.233461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.311867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5e354-8fb9-4c2c-bc07-5b6f27b968fe None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.334022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8370978-f57a-4a31-900f-4d007ae452f4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.344923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.345578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.345908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.346193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.367431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.368305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.368594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.368879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.370115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.371601 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.373838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 41/81] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:00.374611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.400817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.418604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.420617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.444985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.472817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e38249-1355-4cd2-af4b-ef9bf62428a4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.507174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.507978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.508268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.508550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.509722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.511227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.513340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 42/82] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:00.514941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.520847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 41/83] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:00.521696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.617304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.623970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83674818-6e90-4d0d-b835-80a5e834794a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.627124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e82dd-e9c3-4e6b-9752-bce594a57ce7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.649764 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.657870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.658530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.658821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.659114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.663318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.663318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.663318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.663318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.664004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:00.664323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.665714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.678437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 42/84] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:00.679045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.727986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.729476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.776730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21ce16-4b3e-49f2-85e2-3b7132ec3dba None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.811846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.812494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.812783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.813066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.821347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.829506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 43/85] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:00.830379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:00.866219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:00.885280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.889421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.930728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d85ad0-fbd2-4913-9830-7842ad4a3d8f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:00.964483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:00.965163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:00.965457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:00.965740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:00.967135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:00.968613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:00.999386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 43/86] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:01.000239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.065180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 44/87] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:00 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:01.078317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.086469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.104974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d23f9d-4de6-4c9c-ba77-afcf5f9e5d86 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.147911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.149111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.150040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.150333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.150614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.152051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.154713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.161573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 44/88] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:00 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:01.161573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.213230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be4f06-902e-42dd-8bdf-f0ab6ca22d4a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.266863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.268015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.268443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.268859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.270461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.271944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.273725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 45/89] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:01.274816 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.314914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702be851-1151-4784-93a6-6e291d2bc6c0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.360885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.361960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.362233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.362514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.363907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.365647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.367704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:01.368711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.394610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.402763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d9711-e119-4343-bb1a-d5311b249881 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.424673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.456414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.457693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.458271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.458564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.459776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.462260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.464394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 46/91] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:01.465447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.506654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946ba90-007a-43cf-95e2-b708aa9aa86b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.545144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.546017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.546400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.546776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.547711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:01.548181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.549740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.555905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 46/92] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/role_assignments?user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dee54d96dbc846328f01f51027d2178f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:01.556688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.605773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2416f2-6fd5-402e-859b-2a652ee2d272 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.652111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.652947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.653983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.656230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.766215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.770546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:01.784788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.786434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.794879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a075034-13da-4c6b-a165-beecde21be12 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:01.869636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:01.870396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:01.870690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:01.870973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:01.871814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=c92fa328437c4093a3eddeda8c856c28) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:01.872166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:01.873684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:01.885909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 47/93] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/role_assignments?user.id=c92fa328437c4093a3eddeda8c856c28&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:01.886572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:01.900369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 47/94] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:01.908206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:02.003442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1e9b1-aa03-425f-be07-e22d38052169 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:02.040176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:02.040851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:02.041138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:02.041420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:02.042291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] RBAC: Adding query filter params (role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:02.042606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:02.044713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:02.051274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 48/95] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/role_assignments?user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:02.111015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:02.132720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318325-4928-48bf-b85e-711fe2dcb9fb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:02.185680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686a80-f7f7-4bfb-8b98-c10066ad1269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:02.187041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a80-f7f7-4bfb-8b98-c10066ad1269 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:02.187568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a80-f7f7-4bfb-8b98-c10066ad1269 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:02.188064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686a80-f7f7-4bfb-8b98-c10066ad1269 None admin] PATH_INFO: `/v3/projects/2c445b9cafde49828c02ff4533f6b62e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:02.189679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686a80-f7f7-4bfb-8b98-c10066ad1269 None admin] RBAC: Authorizing `identity:get_project(project_id=2c445b9cafde49828c02ff4533f6b62e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:02.191454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686a80-f7f7-4bfb-8b98-c10066ad1269 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:02.193780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 48/96] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:01 2022] GET /identity/v3/projects/2c445b9cafde49828c02ff4533f6b62e => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:02.200395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:02.230250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:02.316109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae088550-dc35-4a02-849c-dc37fc641df8 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:02.374548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:02.375599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:02.376086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:02.376582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:02.377630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=2c445b9cafde49828c02ff4533f6b62e, user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:02.378170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:02.379838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757fc4-e0c7-4132-9f9f-00526d33682d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:02.386531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 49/97] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:02 2022] GET /identity/v3/role_assignments?user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43&scope.project.id=2c445b9cafde49828c02ff4533f6b62e&role.id=dee54d96dbc846328f01f51027d2178f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:03.675264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc308-5bbf-4d9f-873c-3a1e4a030191 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:03.675774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc308-5bbf-4d9f-873c-3a1e4a030191 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:03.675847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcc308-5bbf-4d9f-873c-3a1e4a030191 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:03.677218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 49/98] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:03.682785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bc1e-939c-4ab6-9bc2-5d1c285ee584 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:03.683234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bc1e-939c-4ab6-9bc2-5d1c285ee584 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:03.683396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bc1e-939c-4ab6-9bc2-5d1c285ee584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:03.702287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6699bc1e-939c-4ab6-9bc2-5d1c285ee584 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:03.703478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6699bc1e-939c-4ab6-9bc2-5d1c285ee584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:03.782071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 50/99] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:03.790539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2447e8-f7a5-4e75-82f4-a57bed22948a None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:03.790835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2447e8-f7a5-4e75-82f4-a57bed22948a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:03.791118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2447e8-f7a5-4e75-82f4-a57bed22948a None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:03.792613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 50/100] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:03.797943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:03.798238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:03.798519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:03.814979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:03.821683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:03.822875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:03.830500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2447e8-f7a5-4e75-82f4-a57bed22948a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:03.975577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 51/101] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:04.017890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:04.025453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2447e8-f7a5-4e75-82f4-a57bed22948a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:04.103404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:04.104537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.105013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.105474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.134686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:04.147624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:04.148538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:04.149408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:04.151749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 51/102] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:04.159290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:04.179124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c47e2-46f8-4668-9e49-291f80e4f127 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:04.231079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:04.254551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:04.255373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.255659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.255937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.257226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:04.258765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:04.260392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 52/103] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:04.266809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:04.285826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:04.418201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e43072-ae4a-4043-b414-a388f1e81d23 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:04.421350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cb836-8cb5-47d6-9ec7-1533be330b25 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:04.478874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:04.479741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.480103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.480492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.481370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:04.485821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:04.495459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:04.496390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.496855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.497922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.498857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:04.499329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:04.500896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:04.518541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 52/104] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:04.524194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:04.588195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 53/105] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:03:04 2022] POST /identity/v3/projects => generated 302 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:03:04.635434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:04.661542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5a88e-b678-4e1d-bce8-c18e7264fe2b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:04.713382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509183d-60cd-4122-8aa9-122880f464d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:04.715125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509183d-60cd-4122-8aa9-122880f464d4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.715744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509183d-60cd-4122-8aa9-122880f464d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.716981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509183d-60cd-4122-8aa9-122880f464d4 None admin] PATH_INFO: `/v3/users/a7c3a6bdc8a54184a8a9c3688843bf99` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.737330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509183d-60cd-4122-8aa9-122880f464d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c3a6bdc8a54184a8a9c3688843bf99)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:04.739218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509183d-60cd-4122-8aa9-122880f464d4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:04.741227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 53/106] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:04 2022] GET /identity/v3/users/a7c3a6bdc8a54184a8a9c3688843bf99 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:04.746921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:04.830269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:04.885053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e1a93-bf9c-4f14-aa03-6a293db57d3a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:04.931582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547375-447e-47eb-b396-fb875d1f1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:04.932595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547375-447e-47eb-b396-fb875d1f1e70 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.933131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547375-447e-47eb-b396-fb875d1f1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.933606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547375-447e-47eb-b396-fb875d1f1e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.995516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2571-698e-40c3-96e7-6f509d3fd96c None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:04.996119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2571-698e-40c3-96e7-6f509d3fd96c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:04.996606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2571-698e-40c3-96e7-6f509d3fd96c None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:04.998832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 54/107] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:05.015427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2edb8-3b97-4302-8a41-9a9c217995aa None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.016057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2edb8-3b97-4302-8a41-9a9c217995aa None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.016540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2edb8-3b97-4302-8a41-9a9c217995aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.034384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547375-447e-47eb-b396-fb875d1f1e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:05.036062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547375-447e-47eb-b396-fb875d1f1e70 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:05.041411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4bb2edb8-3b97-4302-8a41-9a9c217995aa None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:05.042910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4bb2edb8-3b97-4302-8a41-9a9c217995aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:05.134852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 55/108] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:05.155305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:05.158185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc97d96-ca5b-4ee2-a509-d4f754fdbffa None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.158483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc97d96-ca5b-4ee2-a509-d4f754fdbffa None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.158769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc97d96-ca5b-4ee2-a509-d4f754fdbffa None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.160247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 56/109] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:05.162482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc97d96-ca5b-4ee2-a509-d4f754fdbffa None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.225464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 54/110] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:05.227149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.227664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.228161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.251094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:05.252637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:05.279794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:05.355082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc97d96-ca5b-4ee2-a509-d4f754fdbffa None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:05.373563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 55/111] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:05.374864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.402539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af812b-e56a-41c4-a792-9aaff2d2913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:05.403978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af812b-e56a-41c4-a792-9aaff2d2913f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.404271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af812b-e56a-41c4-a792-9aaff2d2913f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.404817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af812b-e56a-41c4-a792-9aaff2d2913f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.422641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af812b-e56a-41c4-a792-9aaff2d2913f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a9af812b-e56a-41c4-a792-9aaff2d2913f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:05.436227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:05.437429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:05.438252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 57/112] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:05.438906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52e647-0239-458b-8042-0c42cb780ac6 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.439452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52e647-0239-458b-8042-0c42cb780ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.439452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52e647-0239-458b-8042-0c42cb780ac6 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.441859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 58/113] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:05.441859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52e647-0239-458b-8042-0c42cb780ac6 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.480074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:05.496188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20396bf8-48b6-44d9-97eb-531a837e2291 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:05.534252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:05.535048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.535339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.535620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.536847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:05.538374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:05.540094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 56/114] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:05.540873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.577182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52e647-0239-458b-8042-0c42cb780ac6 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:05.603412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:05.615237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d363b6-14f0-4591-96b6-f8f4a2842146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:05.616026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d363b6-14f0-4591-96b6-f8f4a2842146 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.616318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d363b6-14f0-4591-96b6-f8f4a2842146 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.616674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d363b6-14f0-4591-96b6-f8f4a2842146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.628357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d363b6-14f0-4591-96b6-f8f4a2842146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-99d363b6-14f0-4591-96b6-f8f4a2842146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:05.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:05.639012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:05.639811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:05.646947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 59/115] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:05.646947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.646947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.646947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.649934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781dad-7678-4277-926a-e1f500e8e9c7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:05.661794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:05.663022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:05.687336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:05.688315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.688766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.689268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.690187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:05.690655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:05.692406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa9b45-9205-486b-ba86-d0934101597b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:05.702030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 57/116] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:05.703608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a389421-d3bf-43cd-8d2b-8a5810caf9b0 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.703902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a389421-d3bf-43cd-8d2b-8a5810caf9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.704185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a389421-d3bf-43cd-8d2b-8a5810caf9b0 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.705597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 58/117] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:05.708669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a389421-d3bf-43cd-8d2b-8a5810caf9b0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.726664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:05.737588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 60/118] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:05.752956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.828298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a389421-d3bf-43cd-8d2b-8a5810caf9b0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:05.866240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a848ead-c9a4-4138-980f-31f3e9967cc8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:05.867261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:05.867933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.868369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.868661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.870576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] RBAC: Adding query filter params (role.id=fa34a652ebf044bdbaebad9d1981eec8, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=a7c3a6bdc8a54184a8a9c3688843bf99) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:05.870900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:05.872662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:05.889846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 59/119] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/role_assignments?user.id=a7c3a6bdc8a54184a8a9c3688843bf99&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=fa34a652ebf044bdbaebad9d1981eec8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:05.889846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:05.891166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:05.906920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:05.909952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.909952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.909952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.909952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:05.909952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:05.911186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d78d-51a9-42cd-9a10-c0f74b86c1a6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:05.926036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 61/120] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:05.928906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:05.929530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:05.930074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:05.955313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:05.957211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:05.999258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:06.021464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aad80-1a9c-4256-99c8-236353f0ef1d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.063640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 62/121] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:06.064892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.067845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.069929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.070362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.071370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.072768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.074420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.077082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 60/122] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:05 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:06.078653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.192753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915de5-ddf4-4135-9166-1b85bc89bf07 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.211372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54d71f-f8d7-403f-95f0-e1598f50b53b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.224193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:06.234094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.236473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.236473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.236473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.237937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.239529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.241817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 61/123] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:06.243015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.258179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.259715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.260143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.260844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.267132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:06.276492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:06.287846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:06.288722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:06.289496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:06.292358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 63/124] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:06.293356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.361468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc06bd-1aed-4f0b-a525-04b800079280 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.397058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.398318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.398800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.399267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.400807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.402619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.405537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 62/125] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:06.406629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.411294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a782917-1050-4790-a2e9-146aa1c5c39a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.447212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.448079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.448372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.448655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.461835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:06.470212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:06.471068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:06.471856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 64/126] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:06.472484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.508694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:06.508873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:06.525943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d23121-ee1a-42fd-8483-c0bc23a12f1f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.565575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.567458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.567918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.568277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.569573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.571152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.573490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 63/127] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:06.574373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.603694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3d76-ac1a-4a02-b9c9-a86838af2bd1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.648318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.649856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.650324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.650763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.652153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:06.652618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.655426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.667139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 65/128] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:06.668354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.737380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3932492-4dc0-4719-8880-dc67166d6096 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.776364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:06.798882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760b8f-47bf-41ee-95c0-fcf5be265241 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:06.811103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.812440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.812825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.813264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.816175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a1721e348644e499179fd00d5540e1e, user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.817981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.836032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:06.836973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:06.837258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:06.837506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:06.842245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:06.842245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:06.842245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:06.849526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 66/129] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:06.850272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.879743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 64/130] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:06 2022] PUT /identity/v3/projects/2a1721e348644e499179fd00d5540e1e/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:06.881281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:06.902082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.019321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a04e6-e3f7-45f7-881c-ed7bcacc18c1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.047505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bb355-08b3-4cdf-a739-4726b6671331 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.069439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.073838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.073838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.073838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.081530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.083474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.086163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 65/131] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:06 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:07.087661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:07.101641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.102663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.102960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.103247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e/users/c92fa328437c4093a3eddeda8c856c28/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.105372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a1721e348644e499179fd00d5540e1e, user_id=c92fa328437c4093a3eddeda8c856c28, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.109859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.199939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.209507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 67/132] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:06 2022] PUT /identity/v3/projects/2a1721e348644e499179fd00d5540e1e/users/c92fa328437c4093a3eddeda8c856c28/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:07.210925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:07.242308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.243696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c533a0d-bee8-4dc1-af8e-e484d3e8b2b7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.327666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9bf-1101-4de2-b4a1-0afa86036630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.328743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9bf-1101-4de2-b4a1-0afa86036630 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.329407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9bf-1101-4de2-b4a1-0afa86036630 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.329794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9bf-1101-4de2-b4a1-0afa86036630 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.331319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9bf-1101-4de2-b4a1-0afa86036630 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.333530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9bf-1101-4de2-b4a1-0afa86036630 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.335837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 66/133] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:07 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:07.342905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7533b-c972-44d1-b751-d872631bf929 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.343092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7533b-c972-44d1-b751-d872631bf929 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.343288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7533b-c972-44d1-b751-d872631bf929 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.345071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 67/134] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:07.346000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7533b-c972-44d1-b751-d872631bf929 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:07.422679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882126-e0d3-47ac-844d-ed586bfccb68 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.469650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1db77-445b-457d-891f-4f4057b6b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.470492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1db77-445b-457d-891f-4f4057b6b04a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.470907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1db77-445b-457d-891f-4f4057b6b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.471190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1db77-445b-457d-891f-4f4057b6b04a None admin] PATH_INFO: `/v3/projects/2c445b9cafde49828c02ff4533f6b62e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.472551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1db77-445b-457d-891f-4f4057b6b04a None admin] RBAC: Authorizing `identity:get_project(project_id=2c445b9cafde49828c02ff4533f6b62e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.474206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1db77-445b-457d-891f-4f4057b6b04a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.476107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 68/135] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:07 2022] GET /identity/v3/projects/2c445b9cafde49828c02ff4533f6b62e => generated 312 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:07.477425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.477725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.478031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.495482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7533b-c972-44d1-b751-d872631bf929 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.495962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:07.497732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:07.558558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.559979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.560267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.560545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.561906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.563375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.565116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 68/136] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:07 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:07.565921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:07.579348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 69/137] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:07.580317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:07.592155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.611642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.688513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82100b-2954-4ff1-ae75-c10c9774582d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.724883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.725717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.726029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.726312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.728596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a1721e348644e499179fd00d5540e1e, user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43, role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.730150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.754643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b547449-1f96-4916-b2bb-dcf33f13072a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:07.792230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:07.793142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:07.793434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:07.794406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] PATH_INFO: `/v3/projects/2c445b9cafde49828c02ff4533f6b62e/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:07.796553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c445b9cafde49828c02ff4533f6b62e, user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:07.798150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:07.814855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 70/138] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:07 2022] PUT /identity/v3/projects/2a1721e348644e499179fd00d5540e1e/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43/roles/dec207b48f6f4beb9cc4250b08307111 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:07.815777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:07.894494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 69/139] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:07 2022] PUT /identity/v3/projects/2c445b9cafde49828c02ff4533f6b62e/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:07.934216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:07.977062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3fe53-0aad-46ce-a365-012619f25aa1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:08.023247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0b3f-d2e2-4026-8957-085a9955e369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:08.024140 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0b3f-d2e2-4026-8957-085a9955e369 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:08.024433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0b3f-d2e2-4026-8957-085a9955e369 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:08.024716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0b3f-d2e2-4026-8957-085a9955e369 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:08.026791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0b3f-d2e2-4026-8957-085a9955e369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:08.028443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0b3f-d2e2-4026-8957-085a9955e369 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:08.030643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 71/140] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:08.036284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:08.145025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:08.179739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7ed4c-7ae3-4aa9-995e-2c67d975957f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:08.225371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6991d1-2659-4495-9372-2d592ff4aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:08.226104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6991d1-2659-4495-9372-2d592ff4aea7 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:08.226379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6991d1-2659-4495-9372-2d592ff4aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:08.226658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6991d1-2659-4495-9372-2d592ff4aea7 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:08.227466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6991d1-2659-4495-9372-2d592ff4aea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:08.228875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6991d1-2659-4495-9372-2d592ff4aea7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:08.339225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 70/141] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:08 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:08.384537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131a89-635f-4fcf-b1ab-0ca67cfcab88 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:08.385182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131a89-635f-4fcf-b1ab-0ca67cfcab88 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:08.385696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2131a89-635f-4fcf-b1ab-0ca67cfcab88 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:08.387891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 72/142] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:08.393384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:08.393681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:08.393987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:08.419094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:08.420592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:08.509689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 71/143] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:08.535120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131a89-635f-4fcf-b1ab-0ca67cfcab88 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:08.678901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2131a89-635f-4fcf-b1ab-0ca67cfcab88 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:08.718330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:08.719519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:08.720006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:08.720483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:08.723711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:08.733918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:08.742350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:08.743218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:08.743994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:08.746373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 73/144] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:08.753029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:08.824403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:08.872701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b0b0-ab7f-4e08-ac53-ae797e910dea None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:08.912314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:08.913790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:08.914313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:08.914814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:08.915787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:08.916299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:08.920108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:08.929845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 72/145] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:08.936014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:09.055642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69766c-0e59-4964-8881-295b32c486ca None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:09.092583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:09.093589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:09.093913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:09.094192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] PATH_INFO: `/v3/users/a7c3a6bdc8a54184a8a9c3688843bf99` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:09.095416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c3a6bdc8a54184a8a9c3688843bf99)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:09.096973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:09.098647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 74/146] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:08 2022] GET /identity/v3/users/a7c3a6bdc8a54184a8a9c3688843bf99 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:09.104273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:09.223812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724703d-4071-459e-a9f8-c859f5d47bac None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:09.253617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:09.265863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a389e-c41f-4a00-860c-73ef42773ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:09.266749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a389e-c41f-4a00-860c-73ef42773ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:09.267033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a389e-c41f-4a00-860c-73ef42773ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:09.267419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a389e-c41f-4a00-860c-73ef42773ea5 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:09.274592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a389e-c41f-4a00-860c-73ef42773ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:09.276229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a389e-c41f-4a00-860c-73ef42773ea5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:09.278266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 73/147] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:09 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:09.285137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:09.365762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:09.408674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed710b5b-455f-47dc-808b-7cf79d2c6f40 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:09.447051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8120-cbf2-4dba-b432-61d1d8f5bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:09.448005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8120-cbf2-4dba-b432-61d1d8f5bd0e None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:09.448297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8120-cbf2-4dba-b432-61d1d8f5bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:09.448583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8120-cbf2-4dba-b432-61d1d8f5bd0e None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e/users/a7c3a6bdc8a54184a8a9c3688843bf99/roles/fa34a652ebf044bdbaebad9d1981eec8` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:09.451272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8120-cbf2-4dba-b432-61d1d8f5bd0e None admin] RBAC: Authorizing `identity:create_grant(project_id=2a1721e348644e499179fd00d5540e1e, user_id=a7c3a6bdc8a54184a8a9c3688843bf99, role_id=fa34a652ebf044bdbaebad9d1981eec8)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:09.452749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8120-cbf2-4dba-b432-61d1d8f5bd0e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:09.535488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 75/148] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:09 2022] PUT /identity/v3/projects/2a1721e348644e499179fd00d5540e1e/users/a7c3a6bdc8a54184a8a9c3688843bf99/roles/fa34a652ebf044bdbaebad9d1981eec8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:10.280517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2416-f98a-4b43-9ad7-a746dd75127a None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:10.281017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2416-f98a-4b43-9ad7-a746dd75127a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:10.281124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c2416-f98a-4b43-9ad7-a746dd75127a None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:10.282736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 74/149] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:10.289297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef688-bcd4-414c-a1f5-ea183bb511a2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:10.289885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef688-bcd4-414c-a1f5-ea183bb511a2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:10.289885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef688-bcd4-414c-a1f5-ea183bb511a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:10.310414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-783ef688-bcd4-414c-a1f5-ea183bb511a2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:10.311641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-783ef688-bcd4-414c-a1f5-ea183bb511a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:10.404906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 76/150] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:10.448596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2416-f98a-4b43-9ad7-a746dd75127a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:10.575935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c2416-f98a-4b43-9ad7-a746dd75127a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:10.618060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221c1e-cb81-4950-b73f-76d97da2e8b2 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:10.618375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221c1e-cb81-4950-b73f-76d97da2e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:10.618627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221c1e-cb81-4950-b73f-76d97da2e8b2 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:10.619245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:10.620317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:10.620801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:10.621043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 77/151] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:10.621479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:10.625503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:10.625828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:10.626107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:10.639531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:10.647913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:10.648802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:10.649578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:10.652006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 75/152] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:10.657288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:10.658560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:10.660455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:10.740231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:10.811374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca828c0-f2e3-4886-94eb-a2c89d4a306d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:10.839975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:10.859004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:10.859843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:10.860237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:10.860665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:10.861513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:10.861959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:10.863561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:10.873542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 76/153] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:10.880940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:10.901781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 78/154] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:10.943166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:11.023731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7994fd0-19ee-42a5-9356-5124aee6ff77 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:11.051450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:11.089354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8f43f-6e42-4244-9740-5fa734de1640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:11.090280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f43f-6e42-4244-9740-5fa734de1640 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.091224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f43f-6e42-4244-9740-5fa734de1640 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.091745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8f43f-6e42-4244-9740-5fa734de1640 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.099255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8f43f-6e42-4244-9740-5fa734de1640 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:11.100772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8f43f-6e42-4244-9740-5fa734de1640 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:11.102843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 77/155] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:10 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:11.104113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9845-d7b7-4b43-aa06-734a40b68b9e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.104401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9845-d7b7-4b43-aa06-734a40b68b9e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.104681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d9845-d7b7-4b43-aa06-734a40b68b9e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.106691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 78/156] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:11.107835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f363c7-d0ae-4f7a-af55-dab41db4945d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.108121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f363c7-d0ae-4f7a-af55-dab41db4945d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.108400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f363c7-d0ae-4f7a-af55-dab41db4945d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.109693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 79/157] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:11.119230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e022b-bc71-4052-bed1-ac990f665388 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.119533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e022b-bc71-4052-bed1-ac990f665388 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.119805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e022b-bc71-4052-bed1-ac990f665388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.146741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f4b61-5e24-4857-9ec6-98072d809609 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:11.155732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9e3e022b-bc71-4052-bed1-ac990f665388 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:11.156964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9e3e022b-bc71-4052-bed1-ac990f665388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:11.190687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:11.191498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.191782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.192062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.206922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:11.219756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:11.222459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:11.223255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:11.225620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 79/158] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:11.226424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:11.299459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 80/159] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:11.300845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.301134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.301410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.313009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:11.340109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:11.347405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:11.459086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745bb86-1536-4b2a-9a66-f4a074881504 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:11.501297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 81/160] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:11.503600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:11.523121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:11.523796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.524087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.524370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.591918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:11.692874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407bcd-663f-4a88-a0d8-f0b55a58c801 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:11.727950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:11.729393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:11.753296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:11.754342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:11.754843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:11.755319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:11.756452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:11.756962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:11.758642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:11.769144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 82/161] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:11.769820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:11.843691 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:11.948767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098996e7-0adc-4496-be42-3bb38fce5b04 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:11.957692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:11.992827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 80/162] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:11.993626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:12.001564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.002420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.002707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.002987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.018877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:12.032800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:12.033729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:12.034550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 83/163] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:12.035281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:12.216617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bd38f-89db-49da-9d49-671150d2ff82 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:12.245065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b33c5-bc49-49e6-93bf-cc0ca7982f1a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:12.311093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.311479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.311922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.312184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.312351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.312442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.312634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.312908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.314136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:12.315581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:12.317441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 84/164] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:12 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:12.322643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:12.331844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:12.344129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:12.345286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:12.346550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:12.349101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 81/165] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:12.350214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:12.358238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:12.416176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:12.559104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffecb6-d98b-4137-aea2-bd7e508c7292 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:12.596771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353c65c-904b-45c7-bb74-2326d6c42e7c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:12.623729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.624413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.624705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.624987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.625755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:12.626105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:12.628143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:12.645200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 82/166] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:12.646134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:12.689303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.690212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.690482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.690761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.691951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:12.693406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:12.700861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 85/167] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:12 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:12.701771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:12.755754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:12.795157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46845a68-7ad6-4941-84e4-7c2bcc588cea None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:12.835792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.838008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.839135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.839798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.900099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:12.904107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c77ffb-1d49-480a-a057-223ea630264f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:12.940247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:12.940924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:12.941206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:12.941486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:12.942287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:12.942598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:12.944009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:12.945959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:12.948092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:12.958290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 86/168] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:12.959015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.032096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.071182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 83/169] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:13.076834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.098470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63335905-f368-49c3-8a53-1c8a7a7b6df0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.139869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2653a5-48bd-4b70-b38d-c31800be52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.140847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2653a5-48bd-4b70-b38d-c31800be52b6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.141139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2653a5-48bd-4b70-b38d-c31800be52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.141459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2653a5-48bd-4b70-b38d-c31800be52b6 None admin] PATH_INFO: `/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.142774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2653a5-48bd-4b70-b38d-c31800be52b6 None admin] RBAC: Authorizing `identity:get_user(user_id=b4dabefd3bfb4ca9b3fb0b68b73dfc43)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.144356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2653a5-48bd-4b70-b38d-c31800be52b6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.150316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 87/170] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:12 2022] GET /identity/v3/users/b4dabefd3bfb4ca9b3fb0b68b73dfc43 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:13.150316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780c2c9-5dc6-434a-b940-088bcc765c06 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.150316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780c2c9-5dc6-434a-b940-088bcc765c06 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.150316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780c2c9-5dc6-434a-b940-088bcc765c06 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.150316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 88/171] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:13.150994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb6b5-2d8e-4476-bd56-636ef3bf4f0f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.151285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb6b5-2d8e-4476-bd56-636ef3bf4f0f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.151565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186eb6b5-2d8e-4476-bd56-636ef3bf4f0f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.152985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 89/172] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:13.157418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb6b5-2d8e-4476-bd56-636ef3bf4f0f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.190724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.195337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f508da-9eea-4387-b302-2b45116879fb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.281131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.281794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.282111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.282387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.283222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:13.283536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.285071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.291411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 84/173] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/role_assignments?user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dee54d96dbc846328f01f51027d2178f => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:13.292275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.337058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186eb6b5-2d8e-4476-bd56-636ef3bf4f0f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.348746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.378546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc78e0-76de-428a-b4c2-0a628e06067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.379467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc78e0-76de-428a-b4c2-0a628e06067a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.379752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc78e0-76de-428a-b4c2-0a628e06067a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.380096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc78e0-76de-428a-b4c2-0a628e06067a None admin] PATH_INFO: `/v3/users/c92fa328437c4093a3eddeda8c856c28` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.381458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc78e0-76de-428a-b4c2-0a628e06067a None admin] RBAC: Authorizing `identity:get_user(user_id=c92fa328437c4093a3eddeda8c856c28)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.383156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc78e0-76de-428a-b4c2-0a628e06067a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.389959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 90/174] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/users/c92fa328437c4093a3eddeda8c856c28 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:13.391768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce101-a28c-401f-8341-6e80d0290222 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.391881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce101-a28c-401f-8341-6e80d0290222 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.392098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbce101-a28c-401f-8341-6e80d0290222 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.393617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 91/175] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:13.394362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce101-a28c-401f-8341-6e80d0290222 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.436551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841374e-325b-4079-8351-c2c7c680208f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.483699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffeda8-e6f9-4992-a1f1-56c3e9fc8888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.484584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffeda8-e6f9-4992-a1f1-56c3e9fc8888 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.485329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffeda8-e6f9-4992-a1f1-56c3e9fc8888 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.485614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffeda8-e6f9-4992-a1f1-56c3e9fc8888 None admin] PATH_INFO: `/v3/projects/2c445b9cafde49828c02ff4533f6b62e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.486888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffeda8-e6f9-4992-a1f1-56c3e9fc8888 None admin] RBAC: Authorizing `identity:get_project(project_id=2c445b9cafde49828c02ff4533f6b62e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.489105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffeda8-e6f9-4992-a1f1-56c3e9fc8888 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.491081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 85/176] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/projects/2c445b9cafde49828c02ff4533f6b62e => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:13.492355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115f77-9f91-435d-9e91-ebc07f952613 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.492649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115f77-9f91-435d-9e91-ebc07f952613 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.492930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115f77-9f91-435d-9e91-ebc07f952613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.510702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4d115f77-9f91-435d-9e91-ebc07f952613 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:13.511893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4d115f77-9f91-435d-9e91-ebc07f952613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:13.516238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.521561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbce101-a28c-401f-8341-6e80d0290222 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.557870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61272733-9ef5-4116-82b6-e7e9eaf3f2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.558527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272733-9ef5-4116-82b6-e7e9eaf3f2be None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.558810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272733-9ef5-4116-82b6-e7e9eaf3f2be None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.559136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61272733-9ef5-4116-82b6-e7e9eaf3f2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.584617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 86/177] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:13.592121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.592413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.592969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.611802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:13.612900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:13.626957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272733-9ef5-4116-82b6-e7e9eaf3f2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.628424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61272733-9ef5-4116-82b6-e7e9eaf3f2be None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.636116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.679400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 87/178] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:13.680233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.726002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.730524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 92/179] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:13.732141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123968-a827-400a-9891-f829256dd316 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.732427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123968-a827-400a-9891-f829256dd316 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.732705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3123968-a827-400a-9891-f829256dd316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.749015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e3123968-a827-400a-9891-f829256dd316 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:13.750248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e3123968-a827-400a-9891-f829256dd316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:13.810502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0ce6d-ac3b-404c-a376-2548fa4ff9f8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.833827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 93/180] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:13.833827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174209e-6722-457f-bd74-93d01c55d073 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.833827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174209e-6722-457f-bd74-93d01c55d073 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.833827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174209e-6722-457f-bd74-93d01c55d073 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.833827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 94/181] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:13.833827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174209e-6722-457f-bd74-93d01c55d073 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:13.846594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.847257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.847543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.847825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.874828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.913924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.915419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.928197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174209e-6722-457f-bd74-93d01c55d073 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:13.957040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:13.964827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:13.966069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:13.966460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:13.966786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:13.967703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=2c445b9cafde49828c02ff4533f6b62e, user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:13.968023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:13.969505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:13.975369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 95/182] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/role_assignments?user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43&scope.project.id=2c445b9cafde49828c02ff4533f6b62e&role.id=dee54d96dbc846328f01f51027d2178f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:13.976138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.038759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 88/183] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:14.039799 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.110532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabc42-91b6-4665-b26c-5cb75a576c3e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.121278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.154864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.155595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.155907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.156249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.166968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:14.174905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:14.175822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:14.176637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:14.177256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90042c-8f34-4784-bd91-a33c09c24e72 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.177329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 96/184] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:14.177329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.222911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76932ac9-81fa-4af3-a52d-aeab2fcc912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.223720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76932ac9-81fa-4af3-a52d-aeab2fcc912a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.224012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76932ac9-81fa-4af3-a52d-aeab2fcc912a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.224296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76932ac9-81fa-4af3-a52d-aeab2fcc912a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.234868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76932ac9-81fa-4af3-a52d-aeab2fcc912a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:14.241932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-76932ac9-81fa-4af3-a52d-aeab2fcc912a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:14.242575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:14.243472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:14.244281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 89/185] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:14.245139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.245576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.245671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.262982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:14.264284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:14.293974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7055-65ff-44a5-b16d-92795705978d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.328394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.329285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.329570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.329875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.330422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 90/186] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:14.331224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.331342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.332706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.334453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 97/187] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.335212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.385751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.436622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6abd59-1a70-4a03-9c6e-ad80ec4cd799 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.437992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339a106-5494-4123-bb75-77e2ce086fa2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.456370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.470551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.471510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.471797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.472076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.472836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.473246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.473640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.473959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.474243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.474748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.476492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 98/188] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.477259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.489781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:14.498094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:14.499165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:14.499965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 91/189] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:14.500628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.581942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedbdf5-373c-47d0-b579-f3060f5bb638 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.599661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec5cc1-5436-47f5-9e57-3ba40ed6f0f1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.608959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.614994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.615650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.619214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.619214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.619214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:14.619214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.619214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.627415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 99/190] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.628202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.633919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.634594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.634936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.635419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.636335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:14.636946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.639087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.647771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 92/191] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.648576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.680015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.731197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d3a1d-fe17-48fd-b0ea-e10c91c058d1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.747216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b09c7-ac76-4084-ae04-8a3670aa874e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.765402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.766086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.766369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.766648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.767470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] RBAC: Adding query filter params (role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:14.767778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.769207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.775079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 100/192] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/role_assignments?user.id=b4dabefd3bfb4ca9b3fb0b68b73dfc43&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.778801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.780943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.782015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.782304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.783514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.784856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.786405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.788129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 93/193] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.789604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.838335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.903555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa8ba-ab3d-4c1d-a009-2c0fcabe7f0d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.907460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e649ee-8ffa-4e48-b6f9-83de767fb009 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:14.919727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:14.945783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.946480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.946764 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.947055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.947871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=c92fa328437c4093a3eddeda8c856c28) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:14.948178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.949318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:14.950526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.951192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:14.951489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:14.951824 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:14.952595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:14.953016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:14.954431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:14.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 101/194] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/role_assignments?user.id=c92fa328437c4093a3eddeda8c856c28&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.958500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:14.963969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 94/195] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:14.965599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.093095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.096535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aee21-5a94-4ec4-bf39-cc0ed37e2b0e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.100188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad9e23-68aa-4a45-a396-f0dffc00c42d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.142011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.142592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.143144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.143430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.143526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.143706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] PATH_INFO: `/v3/users/a7c3a6bdc8a54184a8a9c3688843bf99` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.143813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.144472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] PATH_INFO: `/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.144956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] RBAC: Authorizing `identity:get_user(user_id=a7c3a6bdc8a54184a8a9c3688843bf99)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.146473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.148470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 95/196] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/users/a7c3a6bdc8a54184a8a9c3688843bf99 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:15.149237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.159616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] RBAC: Authorizing `identity:get_user(user_id=2ba12d9b45004cf8bb9d767dbafaefb1)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.161204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.164032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 102/197] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:14 2022] GET /identity/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:15.169832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.213329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.261761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e5932-7e89-44a3-aa90-e55a359fe841 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.279926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2ff51-fd06-4d39-a892-4656f944a21a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.297104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.297777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.298094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.298374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.299086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.300549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.313913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.314787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.315070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.315344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] PATH_INFO: `/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.316514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] RBAC: Authorizing `identity:get_user(user_id=2ba12d9b45004cf8bb9d767dbafaefb1)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.317982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.320327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 103/198] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:15 2022] GET /identity/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:15.320327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.416478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b085dd-67ee-4fcf-9fb5-679bec6b608a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.419534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.450244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.450924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.451020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.451262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.453411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 96/199] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:15 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:15.454268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.491393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.530257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.531771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.579046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a505-d847-4f65-81e5-497f89eaf0e3 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.617357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.618045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.618336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.618617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.656176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 104/200] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:15.657040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.660322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.698314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.699485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.724698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.791739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bbcb7-aa3f-480c-a5ed-67f2a2d3d931 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.828274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 97/201] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:15.829138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:15.837597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.838366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.838661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.838943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.912451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.913991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:15.916678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.952590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41aabf-6c4e-4079-8c1e-731842cbf702 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:15.979572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:15.992073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:15.994592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:15.994592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:15.994592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:15.995627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:15.997936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:16.004917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 98/202] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:15 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:16.006054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:16.019866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 105/203] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:16.020900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:16.128240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb6d89-2ccc-4008-9999-7c89482aee4e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:16.131684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:16.142072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d6fc3-cf4d-4c47-852a-6a55261da6e0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:16.166762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:16.167435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:16.167812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:16.168096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:16.169379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] RBAC: Adding query filter params (role.id=fa34a652ebf044bdbaebad9d1981eec8, scope.project.id=2a1721e348644e499179fd00d5540e1e, user.id=a7c3a6bdc8a54184a8a9c3688843bf99) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:16.169863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:16.171365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:16.179323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 106/204] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:16 2022] GET /identity/v3/role_assignments?user.id=a7c3a6bdc8a54184a8a9c3688843bf99&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=fa34a652ebf044bdbaebad9d1981eec8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:16.180361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:16.187447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:16.188341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:16.188622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:16.188894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:16.190942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:16.192474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:16.195231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 99/205] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:16 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:16.203076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:16.284897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:16.315734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fbf5a-4c8c-40f2-8bf2-c59a69a5d1a9 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:16.360382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:16.361910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:16.362392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:16.362862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:16.364698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:16.366455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:16.369642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 107/206] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:16 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:16.379001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:16.415159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128dcb19-aae6-4e58-aa02-c88c52ac0f15 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:16.442829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:16.526634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28034728-ed91-437a-a062-40731177de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:16.527272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28034728-ed91-437a-a062-40731177de6e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:16.527510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28034728-ed91-437a-a062-40731177de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:16.528399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28034728-ed91-437a-a062-40731177de6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:16.530303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28034728-ed91-437a-a062-40731177de6e None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=2ba12d9b45004cf8bb9d767dbafaefb1) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:16.530693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28034728-ed91-437a-a062-40731177de6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:16.532097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28034728-ed91-437a-a062-40731177de6e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:16.533577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea133a99-add8-4d5c-9af1-55ce4f414c3f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:16.555771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 100/207] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:16 2022] GET /identity/v3/role_assignments?user.id=2ba12d9b45004cf8bb9d767dbafaefb1&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:16.573178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:16.574271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:16.574935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:16.575540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:16.576629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] RBAC: Adding query filter params (role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=2ba12d9b45004cf8bb9d767dbafaefb1) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:16.577149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:16.578825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd27a2e-4f1b-4f9b-abcd-4cad65a27e64 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:16.585914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 108/208] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:16 2022] GET /identity/v3/role_assignments?user.id=2ba12d9b45004cf8bb9d767dbafaefb1&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:17.893588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eafe4-15a7-430c-a8c9-b72b8d47a98a None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:17.937987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eafe4-15a7-430c-a8c9-b72b8d47a98a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:17.937987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eafe4-15a7-430c-a8c9-b72b8d47a98a None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:17.937987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 101/209] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:17.938275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:17.938275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:17.938275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:17.938275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:17.938275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:17.967379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc70b-4e38-49f9-af31-7401f04f5254 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:17.967978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc70b-4e38-49f9-af31-7401f04f5254 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:17.968476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc70b-4e38-49f9-af31-7401f04f5254 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:17.970132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 102/210] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:17.975273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:17.975779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:17.976294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:17.990950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 109/211] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:17.996029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:17.998164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:18.018054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:18.049357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:18.079696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 103/212] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:18.109314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:18.141471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0da5b5-fbee-4ebe-a1b4-36379e90e57b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:18.167346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:18.180476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:18.181613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.186699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.186699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.186699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:18.186699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:18.187890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 110/213] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:18.193729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:18.215228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9592-5409-4ac0-b018-db43bc081cd7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:18.252309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:18.253121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.253543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.253787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.265189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:18.273332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:18.274333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:18.275171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 104/214] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:18.281442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:18.303827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:18.307966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1adbe4-3d9d-4c7e-9d90-a3d8466e23d4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:18.345006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:18.346193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.346792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.347272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.348196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:18.350106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:18.392317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5f6c-1379-4fb9-bf7d-88aee70563ff None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:18.408347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:18.430510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:18.431115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.431407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.431738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.437917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:18.437917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:18.437917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:18.438958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 111/215] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:18 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:18.453070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 105/216] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:18.454798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:18.576648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92baaced-1503-4e40-ad07-66415372d025 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:18.618031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406f5a3-4afe-4c8d-8dac-a6ccbf3fd594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:18.618978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f5a3-4afe-4c8d-8dac-a6ccbf3fd594 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.619273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f5a3-4afe-4c8d-8dac-a6ccbf3fd594 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.619554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406f5a3-4afe-4c8d-8dac-a6ccbf3fd594 None admin] PATH_INFO: `/v3/users/ffc86dc2feea4f1580fc6d32bef8b99b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.634583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406f5a3-4afe-4c8d-8dac-a6ccbf3fd594 None admin] RBAC: Authorizing `identity:get_user(user_id=ffc86dc2feea4f1580fc6d32bef8b99b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:18.636073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406f5a3-4afe-4c8d-8dac-a6ccbf3fd594 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:18.638620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 112/217] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:18 2022] GET /identity/v3/users/ffc86dc2feea4f1580fc6d32bef8b99b => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:18.644577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:18.763831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9648-9f5e-40b4-8938-833c6b70ca7a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:18.791334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf99c6-32eb-41d2-bc52-d7cfff958309 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.792244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf99c6-32eb-41d2-bc52-d7cfff958309 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.793001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf99c6-32eb-41d2-bc52-d7cfff958309 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.796104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 113/218] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:18.800869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe591b-d60f-4847-ba59-d2d42d6639fd None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.801596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe591b-d60f-4847-ba59-d2d42d6639fd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.802097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe591b-d60f-4847-ba59-d2d42d6639fd None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.805471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 114/219] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:18.807014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdabe-755f-479a-82d5-3da0e1b833a8 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.807523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdabe-755f-479a-82d5-3da0e1b833a8 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.807862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:18.807985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffdabe-755f-479a-82d5-3da0e1b833a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.808460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.808747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.809099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.828847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f2ffdabe-755f-479a-82d5-3da0e1b833a8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:18.830088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f2ffdabe-755f-479a-82d5-3da0e1b833a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:18.838531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:18.876746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:18.901153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:18.902823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:18.921119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 115/220] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:18.922457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:18.922747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:18.923028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:18.962121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:18.962121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:19.033158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 106/221] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:19.035469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.035718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 116/222] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:19.037521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.120175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.124837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.149475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac779b9-3094-4427-a8d1-f1c158871d60 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.153165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d83f6-e99c-46dd-a648-4425493d77c0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.193458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.193705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.194448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.194684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.194787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.194970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.195079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.195396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.196230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:19.197963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:19.200565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 117/223] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:19.201969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.207798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:19.218271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:19.219229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:19.220192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 107/224] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:19.221533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.328303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc055fa-3805-4d9e-8bcf-8cce1128e152 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.338472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3a884-3516-45ac-909c-d30d06676002 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.367253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.368230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.368617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.368968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.375012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.375683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.375965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.376241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.377245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=ffc86dc2feea4f1580fc6d32bef8b99b) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:19.377628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.378699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:19.380311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:19.381362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:19.383841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.388006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 108/225] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/role_assignments?user.id=ffc86dc2feea4f1580fc6d32bef8b99b&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dee54d96dbc846328f01f51027d2178f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:19.388913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:19.391551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:19.399010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:19.399820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 118/226] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:19.402273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.507627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec8233-d31b-4f99-9315-0d303147b1e2 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.519169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e382d3-cf06-4ed0-afb9-79912d28bff6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.552159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.553272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.553762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.555320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.557053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:19.557742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:19.560851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:19.575678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.576880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.578446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.579123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.586351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:19.587017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:19.588698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:19.590987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 109/227] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:19.594905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.600884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 119/228] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:19.607588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.690180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.700189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:19.739834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a7700-e7f6-4442-b178-322981502a91 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.778937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.780554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.780982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.781412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] PATH_INFO: `/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.782991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba12d9b45004cf8bb9d767dbafaefb1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:19.785019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:19.787247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 110/229] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:19.795159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.822468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2988a-cc73-4e79-81d9-d6ff542bd3d6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:19.895995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:19.896819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:19.897104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:19.897378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] PATH_INFO: `/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:19.898776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba12d9b45004cf8bb9d767dbafaefb1)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:19.900259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:19.905408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 120/230] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:19.910818 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:19.974413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a88e-7dbc-46af-9178-c23c5d9a65e1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:20.023781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c084d5c-4b1a-45da-a338-e7bc191ff338 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:20.030191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:20.045114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:20.050790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.050790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.050790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.050790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:20.050790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:20.052530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 111/231] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:20.058583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:20.078810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:20.085047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:20.085954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.086241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.086514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.089202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:20.091265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:20.101850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 121/232] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:19 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:20.101850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:20.254857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f456daf-758a-44eb-b191-a8a563bc74ab None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:20.292879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df87c-0692-430c-a5c9-357d2939e683 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:20.328962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690a6dc-587d-4715-9f1b-bac185951422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:20.330188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a6dc-587d-4715-9f1b-bac185951422 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.330636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a6dc-587d-4715-9f1b-bac185951422 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.331081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690a6dc-587d-4715-9f1b-bac185951422 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009/users/2ba12d9b45004cf8bb9d767dbafaefb1/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.332727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3216c88-4416-4220-86a2-61c9e62f5dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:20.333795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216c88-4416-4220-86a2-61c9e62f5dc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.334247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216c88-4416-4220-86a2-61c9e62f5dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.334686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3216c88-4416-4220-86a2-61c9e62f5dc1 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009/users/2ba12d9b45004cf8bb9d767dbafaefb1/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.336825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216c88-4416-4220-86a2-61c9e62f5dc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=13ee90153ae24027b221573ef43bb009, user_id=2ba12d9b45004cf8bb9d767dbafaefb1, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:20.338468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3216c88-4416-4220-86a2-61c9e62f5dc1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:20.339729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690a6dc-587d-4715-9f1b-bac185951422 None admin] RBAC: Authorizing `identity:create_grant(project_id=13ee90153ae24027b221573ef43bb009, user_id=2ba12d9b45004cf8bb9d767dbafaefb1, role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:20.341892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690a6dc-587d-4715-9f1b-bac185951422 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:20.420652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 122/233] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:20 2022] PUT /identity/v3/projects/13ee90153ae24027b221573ef43bb009/users/2ba12d9b45004cf8bb9d767dbafaefb1/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:20.454462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 112/234] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:20 2022] PUT /identity/v3/projects/13ee90153ae24027b221573ef43bb009/users/2ba12d9b45004cf8bb9d767dbafaefb1/roles/dec207b48f6f4beb9cc4250b08307111 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:20.967123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d11d1-2cf8-45dc-8ddf-884661e616dc None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.967853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d11d1-2cf8-45dc-8ddf-884661e616dc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.968368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d11d1-2cf8-45dc-8ddf-884661e616dc None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.970004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 123/235] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:20.975506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.975952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.976120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.989369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851b62-61bd-4f68-ae09-9743da710ff2 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.990050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851b62-61bd-4f68-ae09-9743da710ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.990540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3851b62-61bd-4f68-ae09-9743da710ff2 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.992398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 124/236] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:20.997320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:20.997612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:20.998010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:20.999715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:21.000922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:21.016054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:21.017562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:21.093949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:21.118538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:21.122648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 113/237] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:21.133648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 125/238] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:21.151237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:21.171974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:21.331439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63521c5-473d-4836-a481-1dbd35223071 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:21.359071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd55b3-e8ac-4a48-afca-d3882aca293f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:21.402381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:21.403837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.404117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.404644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.425433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:21.433198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:21.434917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:21.435724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:21.436353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:21.436440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.437004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.437004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.438179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:21.439639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:21.441428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 126/239] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:21.442183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 114/240] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:21.447216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:21.448390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:21.551438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:21.552085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:21.632622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9a891-cfbd-46af-b020-40e74b4de4be None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:21.648749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cfde-3194-4371-9c1a-4bf8377b4ea6 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:21.695053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb05a-6dc2-4483-a3ef-47373a803c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:21.695777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb05a-6dc2-4483-a3ef-47373a803c8d None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.696063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb05a-6dc2-4483-a3ef-47373a803c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.696338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb05a-6dc2-4483-a3ef-47373a803c8d None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.697057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb05a-6dc2-4483-a3ef-47373a803c8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:21.699294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb05a-6dc2-4483-a3ef-47373a803c8d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:21.711049 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:21.711728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.712014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.712296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.713048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:21.713406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:21.715845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:21.726585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 115/241] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:21.732857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:21.811172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 127/242] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:21 2022] POST /identity/v3/users => generated 293 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:21.819784 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221951ea-9e79-47fe-8aa4-bead5eff75bc None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.820080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221951ea-9e79-47fe-8aa4-bead5eff75bc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.820353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221951ea-9e79-47fe-8aa4-bead5eff75bc None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.822011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 128/243] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:21.828500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.830056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.830056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.846662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a65a-a95d-4321-a44d-5e881d48dd0f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:21.859801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:21.868731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:21.869823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:21.888661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:21.890025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:21.890529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:21.891075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] PATH_INFO: `/v3/users/410a0f3f79474e1bb6cf4af9b84f555f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:21.909959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] RBAC: Authorizing `identity:get_user(user_id=410a0f3f79474e1bb6cf4af9b84f555f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:21.911961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:21.914375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 116/244] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:21 2022] GET /identity/v3/users/410a0f3f79474e1bb6cf4af9b84f555f => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:21.920267 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.026298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 129/245] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:22.055149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.108275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1943b6-ab90-4015-899b-3dfab2125c56 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.113776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:22.146021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.147048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.147547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.148455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.182122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d868-8291-4edf-a723-f849c3fbbeab None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.201962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:22.237177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.238013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.238296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.238621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.244075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:22.245792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:22.251114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:22.262663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:22.263623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:22.264448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 130/246] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:22.273824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.372939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 117/247] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:22.378894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.400093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4669ae7-fe1f-4324-88fd-bf688c49264f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.401680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:22.447134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.447964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.448460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.448919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.452064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:22.452489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:22.454722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:22.462205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:22.467378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 131/248] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:22.476318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.503153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455f08e-32eb-4c8b-b1a9-47beeb3476e9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.548991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.549922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.550420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.550662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.552472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:22.554132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:22.556696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 118/249] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:22 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:22.563516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.601752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0139fb-2749-4977-a061-aa0beb6db674 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.640439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.641339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.641627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.642853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] PATH_INFO: `/v3/users/ffc86dc2feea4f1580fc6d32bef8b99b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.644135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] RBAC: Authorizing `identity:get_user(user_id=ffc86dc2feea4f1580fc6d32bef8b99b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:22.645631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:22.647632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 132/250] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:22 2022] GET /identity/v3/users/ffc86dc2feea4f1580fc6d32bef8b99b => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:22.653594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:22.677009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76ae4e-f165-4f4c-abdc-05bc603f7dfb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.688456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:22.717125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.717786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.718144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.718419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.719257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] RBAC: Adding query filter params (role.id=fa34a652ebf044bdbaebad9d1981eec8, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=410a0f3f79474e1bb6cf4af9b84f555f) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:22.719567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:22.721028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:22.724636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:22.734003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 119/251] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:22 2022] GET /identity/v3/role_assignments?user.id=410a0f3f79474e1bb6cf4af9b84f555f&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=fa34a652ebf044bdbaebad9d1981eec8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:22.801976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5037f5-45ad-42fd-ba4b-a8b2c38363b7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:22.851288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafe572-8663-4d84-ab74-ba98e1b4b765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:22.852190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafe572-8663-4d84-ab74-ba98e1b4b765 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:22.852480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafe572-8663-4d84-ab74-ba98e1b4b765 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:22.852763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafe572-8663-4d84-ab74-ba98e1b4b765 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:22.854171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafe572-8663-4d84-ab74-ba98e1b4b765 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:22.855753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafe572-8663-4d84-ab74-ba98e1b4b765 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:22.857760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 133/252] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:22 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:22.863524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.006316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad89c-6502-4a0c-8527-b339ebf53778 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.006657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad89c-6502-4a0c-8527-b339ebf53778 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.006835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad89c-6502-4a0c-8527-b339ebf53778 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.007498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a32c5c-8550-42d0-9480-e0dd4d7f9b1d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:23.008432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 134/253] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:23.013796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8438a-de3e-427c-b6bb-5ec33ed87e7e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.014135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8438a-de3e-427c-b6bb-5ec33ed87e7e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.014420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8438a-de3e-427c-b6bb-5ec33ed87e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.049972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f8c8438a-de3e-427c-b6bb-5ec33ed87e7e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:23.051153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f8c8438a-de3e-427c-b6bb-5ec33ed87e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:23.064054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:23.070412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.070967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.071500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009/users/ffc86dc2feea4f1580fc6d32bef8b99b/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.084855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] RBAC: Authorizing `identity:create_grant(project_id=13ee90153ae24027b221573ef43bb009, user_id=ffc86dc2feea4f1580fc6d32bef8b99b, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:23.086679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:23.168127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 135/254] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:23.177823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d2d21-7e5f-4286-a93a-5666d98747cb None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.177823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d2d21-7e5f-4286-a93a-5666d98747cb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.177823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d2d21-7e5f-4286-a93a-5666d98747cb None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.177823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 136/255] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:23.183553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.184639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.184947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.206539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 120/256] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:22 2022] PUT /identity/v3/projects/13ee90153ae24027b221573ef43bb009/users/ffc86dc2feea4f1580fc6d32bef8b99b/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:23.207247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.272770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:23.274323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:23.326184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:23.329209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:23.407250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26170a-a259-4da5-bb96-80b006798741 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:23.429933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 137/257] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:23.447736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.480515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:23.481510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.481837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.482114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.507983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:23.523330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:23.524264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:23.525072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:23.528556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 121/258] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:23.534918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.570953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41a89-c55a-46aa-89d4-95f3cc15318d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:23.612047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:23.612871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.613153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.613429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.633262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:23.641844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:23.642803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:23.643613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 138/259] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:23.649019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.675247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:23.748877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a5832-dc9f-4953-8196-842dac0bdfd5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:23.769733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e175f48-da55-46c0-862e-3cd14b7507e9 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:23.786704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:23.814325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:23.815002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.815289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.815570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.816334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:23.816647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:23.818075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:23.834670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 122/260] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:23.837792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:23.838494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:23.838779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:23.839057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:23.840032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:23.840355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:23.841762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:23.844155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.865065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 139/261] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:23.866428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:23.958253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:23.971366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219e043-ce4b-4f33-acd2-5f9e90455cda None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:24.037694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:24.038536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:24.038818 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:24.039095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] PATH_INFO: `/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:24.040485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba12d9b45004cf8bb9d767dbafaefb1)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:24.041987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:24.044349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 140/262] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:23 2022] GET /identity/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:24.053034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:24.076396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff5f3c-96d7-4340-ad88-f0779981b256 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:24.170654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:24.171559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:24.171891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:24.172169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] PATH_INFO: `/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:24.173489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba12d9b45004cf8bb9d767dbafaefb1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:24.174989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:24.176630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 123/263] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:23 2022] GET /identity/v3/users/2ba12d9b45004cf8bb9d767dbafaefb1 => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:24.186668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:24.284210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:24.302074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69aa2e-4898-45dd-850c-2eec3c26d730 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:24.370762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0964ba-c96b-4c3e-8885-63be2f9e3526 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:24.387999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:24.388670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:24.388979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:24.389258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:24.424430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:24.425103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:24.425393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:24.425678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:24.434765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:24.523202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:24.524719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:24.607344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:24.608783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:24.635276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 141/264] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:24.636545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:24.714213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:24.730163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:24.802736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 124/265] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:24.808674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:24.835931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c32f-3575-4983-8801-c8ae816564f4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:24.920582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa98ba0-01df-4f3f-8048-d6a8e9f9bf01 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:24.958217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:24.959204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:24.959499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:24.959783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:24.960992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:24.962638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:24.964358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 125/266] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:24 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:24.970529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:24.970936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:24.971424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:24.971711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:24.971987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:24.974534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:24.976005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:24.978121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 142/267] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:24 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:24.998172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:25.003999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:25.111101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccac81-39b5-4b5b-9ff9-9bb2947d7039 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:25.168310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:25.169254 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.169750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.170211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.171261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=2ba12d9b45004cf8bb9d767dbafaefb1) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:25.171727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:25.173368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cac99-35f5-413d-ab28-eaa06e473cf7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:25.185724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 126/268] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:24 2022] GET /identity/v3/role_assignments?user.id=2ba12d9b45004cf8bb9d767dbafaefb1&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:25.187314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89205-3eef-453f-8a8c-c8448d17c288 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.187967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89205-3eef-453f-8a8c-c8448d17c288 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.189026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89205-3eef-453f-8a8c-c8448d17c288 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.190802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 127/269] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:25.199118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0ea4-3b1e-4d52-a3f4-817baf9ad0fd None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.199913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0ea4-3b1e-4d52-a3f4-817baf9ad0fd None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.201173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc0ea4-3b1e-4d52-a3f4-817baf9ad0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.212247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7a604-1497-4fa6-8c8b-1df8711c0fec None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:25.233331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-48bc0ea4-3b1e-4d52-a3f4-817baf9ad0fd None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:25.237318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-48bc0ea4-3b1e-4d52-a3f4-817baf9ad0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:25.263465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:25.298564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:25.299479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.299938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.300528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.302923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] RBAC: Adding query filter params (role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=2ba12d9b45004cf8bb9d767dbafaefb1) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:25.304718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:25.307074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:25.318446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 143/270] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:25 2022] GET /identity/v3/role_assignments?user.id=2ba12d9b45004cf8bb9d767dbafaefb1&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:25.373435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 128/271] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:25.410598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:25.508914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ea5b1-0161-4989-9bce-554eacc2c10f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.508914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ea5b1-0161-4989-9bce-554eacc2c10f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.508914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ea5b1-0161-4989-9bce-554eacc2c10f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.508914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 129/272] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:25.517248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.517873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.518440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.551725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e969a9-f00f-411c-8256-292e8f03cb36 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:25.554365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:25.555576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:25.564435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:25.594103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:25.595237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.595736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.596223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.613790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:25.622730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:25.623664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:25.624475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:25.627074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 144/273] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:25.632905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:25.682425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 130/274] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:25.690211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:25.716604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:25.759306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe64cb-787f-4e7c-b2e0-8783124cc0a5 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:25.806033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:25.807068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.807556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.808033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.809233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:25.809748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:25.811411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:25.820744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 145/275] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:25.826539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:25.854540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3d291-e9cf-4518-970e-67a7abcd334e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:25.896983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:25.898182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:25.898673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:25.899146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:25.900555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:25.902893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:25.905089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 131/276] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:25.916279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:25.933553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:25.969059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e08680-c7ae-4898-bdb0-91bcb52a316d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:25.972767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:26.008700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e17c4a-911b-41c8-bcb6-61375cfe7ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.010089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e17c4a-911b-41c8-bcb6-61375cfe7ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.010507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e17c4a-911b-41c8-bcb6-61375cfe7ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.010923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e17c4a-911b-41c8-bcb6-61375cfe7ce8 None admin] PATH_INFO: `/v3/users/dcc5edb3d2dd4b64b0e397aebfc00458` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.026836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e17c4a-911b-41c8-bcb6-61375cfe7ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5edb3d2dd4b64b0e397aebfc00458)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:26.029971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e17c4a-911b-41c8-bcb6-61375cfe7ce8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:26.032976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 146/277] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:25 2022] GET /identity/v3/users/dcc5edb3d2dd4b64b0e397aebfc00458 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:26.034424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665270-382e-426f-8f3a-a262b4477de0 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.034854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665270-382e-426f-8f3a-a262b4477de0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.035350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665270-382e-426f-8f3a-a262b4477de0 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.037181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 147/278] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:26.039679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665270-382e-426f-8f3a-a262b4477de0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.054600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19736fd6-bfa7-424e-a6c6-3e21ad2e8f8b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:26.106989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac870f3-6c99-42cb-8f84-eeb569bd30a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.107764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac870f3-6c99-42cb-8f84-eeb569bd30a1 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.108114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac870f3-6c99-42cb-8f84-eeb569bd30a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.108483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac870f3-6c99-42cb-8f84-eeb569bd30a1 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.109248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac870f3-6c99-42cb-8f84-eeb569bd30a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:26.110871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac870f3-6c99-42cb-8f84-eeb569bd30a1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:26.160571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665270-382e-426f-8f3a-a262b4477de0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:26.196126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.196842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.197113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.197393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.198927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, user.id=dcc5edb3d2dd4b64b0e397aebfc00458, scope.system=all) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:26.198927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:26.200425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:26.205929 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 132/279] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:25 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:03:26.206456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 148/280] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/role_assignments?user.id=dcc5edb3d2dd4b64b0e397aebfc00458&scope.system=all&role.id=dee54d96dbc846328f01f51027d2178f => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:26.208096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ebfed-eddb-4243-bc00-408452199056 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.208432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ebfed-eddb-4243-bc00-408452199056 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.208711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ebfed-eddb-4243-bc00-408452199056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.236752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0d2ebfed-eddb-4243-bc00-408452199056 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:26.237788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0d2ebfed-eddb-4243-bc00-408452199056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:26.311312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:26.321429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 133/281] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:26.347596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.383418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:26.479713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc9b59-3e37-4095-9e72-889898b9035c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:26.503438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1a80-3791-4318-a66a-08cacda6c9d9 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.503962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1a80-3791-4318-a66a-08cacda6c9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.503962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1a80-3791-4318-a66a-08cacda6c9d9 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.506842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 134/282] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:26.511244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.511539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.511852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.527856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.529627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.529950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.530229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.533627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:26.534913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:26.552291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:26.560858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:26.561953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:26.562952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 149/283] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:26.568130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.623229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 135/284] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:26.650100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.676673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:26.694477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274f5a6-7fd3-41bf-9441-fb770ed39a27 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:26.736448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.737138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.737457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.737830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.738771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:26.739102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:26.740501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:26.750584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 150/285] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:26.756512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.780397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e162dd-3670-4b43-bc6e-977096ced4e2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:26.815233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:26.831190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.832105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.832391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.832669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.848005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:26.862725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:26.863716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:26.864998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 136/286] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:26.869756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53816a75-76f3-4b39-bb53-c8a36b452891 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:26.872649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.909057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:26.909991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:26.910283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:26.910563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] PATH_INFO: `/v3/users/410a0f3f79474e1bb6cf4af9b84f555f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:26.911846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] RBAC: Authorizing `identity:get_user(user_id=410a0f3f79474e1bb6cf4af9b84f555f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:26.913310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:26.915006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 151/287] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/users/410a0f3f79474e1bb6cf4af9b84f555f => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:26.921582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:26.943110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:27.024138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0971-69c0-4eba-bf21-82cb8ff8e1b4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.037407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b6a08-2df0-4b5c-ab5c-564bf8ddb20c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.062550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.063232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.063624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.063906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.064769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:27.065083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.071652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.076200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.077137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.077429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.077709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.081628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.083138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.084449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 137/288] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:27.084975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 152/289] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:26 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:27.089756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:27.094377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:27.145718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:27.188190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:27.203175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad808dbb-5850-4af8-9c44-231edb695a03 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.204555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f334cf-a496-4851-abd1-91a658e5f2fe None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.240609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.240972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.241510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.241749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.241939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.242086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.242243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009/users/410a0f3f79474e1bb6cf4af9b84f555f/roles/fa34a652ebf044bdbaebad9d1981eec8` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.242391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] PATH_INFO: `/v3/users/ffc86dc2feea4f1580fc6d32bef8b99b` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.243714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] RBAC: Authorizing `identity:get_user(user_id=ffc86dc2feea4f1580fc6d32bef8b99b)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.244152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=13ee90153ae24027b221573ef43bb009, user_id=410a0f3f79474e1bb6cf4af9b84f555f, role_id=fa34a652ebf044bdbaebad9d1981eec8)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.245193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.245712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.247553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 138/290] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:27 2022] GET /identity/v3/users/ffc86dc2feea4f1580fc6d32bef8b99b => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:27.253133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:27.308232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 153/291] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:03:27 2022] PUT /identity/v3/projects/13ee90153ae24027b221573ef43bb009/users/410a0f3f79474e1bb6cf4af9b84f555f/roles/fa34a652ebf044bdbaebad9d1981eec8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:03:27.361630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90006ae4-26c8-4e9a-aaee-bad126a0eb8f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.386771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:27.399219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.399879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.403153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.403153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.476619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.478185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.589018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 139/292] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:27.594915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:27.718797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70428-12c6-437b-b180-a324fd846e85 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.755040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affd0d8-d510-4738-b3a9-013ad5639490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.756325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affd0d8-d510-4738-b3a9-013ad5639490 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.756814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affd0d8-d510-4738-b3a9-013ad5639490 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.757294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affd0d8-d510-4738-b3a9-013ad5639490 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.758813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affd0d8-d510-4738-b3a9-013ad5639490 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.760480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affd0d8-d510-4738-b3a9-013ad5639490 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.762823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 154/293] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:27 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:27.769849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:27.795047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:27.891708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01ed4d-bc00-4932-9694-2fe10d5d8676 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:27.933442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:27.934203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:27.934490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:27.934768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:27.935607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=ffc86dc2feea4f1580fc6d32bef8b99b) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:27.935920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:27.937378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9c5b6-098a-4080-9cf4-be188cc42e12 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:27.947809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 140/294] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:27 2022] GET /identity/v3/role_assignments?user.id=ffc86dc2feea4f1580fc6d32bef8b99b&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dee54d96dbc846328f01f51027d2178f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:28.584939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236603-0815-4306-9093-bb47c91781c1 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:28.585652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236603-0815-4306-9093-bb47c91781c1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:28.586172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236603-0815-4306-9093-bb47c91781c1 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:28.587775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 155/295] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:28.593492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:28.594413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:28.594920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:28.616458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:28.617666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:28.696732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 141/296] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:28.719912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236603-0815-4306-9093-bb47c91781c1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:28.736933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:28.831351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236603-0815-4306-9093-bb47c91781c1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:28.869103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:28.869875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:28.870170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:28.870455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:28.881438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:28.889430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:28.890389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:28.891205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 156/297] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:28.898422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:28.911359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.009387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f341c1-72fc-4146-90d9-e4eec20d661d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.044547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.045221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.045503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.045780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.046555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:29.046862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:29.048255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a9288-3754-4666-82c2-880f39987e4e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:29.057030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 142/298] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:29.063272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.102144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf461-0c61-4d50-9168-b050b3ec23a2 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.102445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf461-0c61-4d50-9168-b050b3ec23a2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.102710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbf461-0c61-4d50-9168-b050b3ec23a2 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.105311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 143/299] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:29.110262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96134028-c6f9-4bb4-8414-64bf4e025b15 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.111015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96134028-c6f9-4bb4-8414-64bf4e025b15 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.111307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96134028-c6f9-4bb4-8414-64bf4e025b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.132797 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-96134028-c6f9-4bb4-8414-64bf4e025b15 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:29.134376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-96134028-c6f9-4bb4-8414-64bf4e025b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:29.142062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.175217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa199d-be46-429d-ae85-3e4222b2d33a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.250934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 144/300] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:29.252265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabf7b2-5c0d-4cef-b3b8-719bb4e2c980 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.252560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabf7b2-5c0d-4cef-b3b8-719bb4e2c980 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.252842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabf7b2-5c0d-4cef-b3b8-719bb4e2c980 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.254313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 145/301] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:29.259323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.259615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.259904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.260022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.261220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.261734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.262240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] PATH_INFO: `/v3/users/dcc5edb3d2dd4b64b0e397aebfc00458` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.263818 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5edb3d2dd4b64b0e397aebfc00458)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:29.266101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.266911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:29.268709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 157/302] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:29 2022] GET /identity/v3/users/dcc5edb3d2dd4b64b0e397aebfc00458 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:29.273840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.280588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:29.281794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:29.359534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 146/303] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:29.360753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.399453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d609f-c424-4615-9cff-adef6d34fc8d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.439295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.440287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.440576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.440973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] PATH_INFO: `/v3/system/users/dcc5edb3d2dd4b64b0e397aebfc00458/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.442470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dcc5edb3d2dd4b64b0e397aebfc00458, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:29.443867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:29.471537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee80d9f-6253-4b7d-a8f1-84c28296736b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.502629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.507261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.508120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.508406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.508686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.509878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:29.511355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:29.513115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 147/304] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:29.513899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.545421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 158/305] 10.222.0.64 () {58 vars in 1334 bytes} [Mon Jun 20 12:03:29 2022] PUT /identity/v3/system/users/dcc5edb3d2dd4b64b0e397aebfc00458/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:03:29.546820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.586181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.649259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15479-92d7-4795-9c7c-f22bcfa49af5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.677792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8ac7-2645-449a-9f3e-66df6316fc3e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.698158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.699015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.699477 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.699824 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.714284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:29.719615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590f0d-9730-461f-b2e7-36f30fdbefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.720551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590f0d-9730-461f-b2e7-36f30fdbefa4 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.721549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590f0d-9730-461f-b2e7-36f30fdbefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.722054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590f0d-9730-461f-b2e7-36f30fdbefa4 None admin] PATH_INFO: `/v3/groups` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.722971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b590f0d-9730-461f-b2e7-36f30fdbefa4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:29.723673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:29.724689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:29.725763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 148/306] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:29.727650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b590f0d-9730-461f-b2e7-36f30fdbefa4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:29.731397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.797434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.802702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 159/307] 10.222.0.64 () {60 vars in 1134 bytes} [Mon Jun 20 12:03:29 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:29.804160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e660b9-5366-4aec-b742-a1cfc296f1f0 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.804587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e660b9-5366-4aec-b742-a1cfc296f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.805013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e660b9-5366-4aec-b742-a1cfc296f1f0 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.806711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 160/308] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:29.819735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.819735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.820038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.839350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:29.840681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:29.850078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc5ca-26fa-49b6-9ead-94391caca6c7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:29.903482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:29.905254 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:29.905615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:29.906044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:29.907234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:29.907875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:29.910290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:29.911519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:29.924112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 149/309] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:29.924908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 161/310] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:29.929883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:29.946124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:30.075094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45bb24-178e-4ebb-8cd8-ef763436bc67 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.078853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde0f9e-c9d5-44f0-987f-8923d25c165d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.104851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:30.119171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.120060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.120368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.120493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.120807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.122302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.122736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.123157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] PATH_INFO: `/v3/users/f7a9b6aee11a4488ba53aef87962b6e0` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.133214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:30.139712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] RBAC: Authorizing `identity:get_user(user_id=f7a9b6aee11a4488ba53aef87962b6e0)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:30.141376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:30.142067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:30.143167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:30.144166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:30.145616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 162/311] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:30.146653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 150/312] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:29 2022] GET /identity/v3/users/f7a9b6aee11a4488ba53aef87962b6e0 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:30.151494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:30.152486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:30.213151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:30.263609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f8a7d-ff1b-4b58-b86b-bb89be3f9eec None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.280819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0900f8-464f-432e-9301-c96c9d9f3db8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.304248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.305323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.306198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.306492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.307259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:30.307576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:30.309515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:30.319549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 163/313] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:30.327525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:30.329420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.330302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.330810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.331237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.332330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] RBAC: Adding query filter params (role.id=fa34a652ebf044bdbaebad9d1981eec8, user.id=f7a9b6aee11a4488ba53aef87962b6e0, scope.system=all) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:30.332826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:30.334628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:30.341158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 151/314] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jun 20 12:03:30 2022] GET /identity/v3/role_assignments?user.id=f7a9b6aee11a4488ba53aef87962b6e0&scope.system=all&role.id=fa34a652ebf044bdbaebad9d1981eec8 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:30.454917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad698a47-de46-4167-b1a7-207d13498572 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.473519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:30.492528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.493418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.493705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.494116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] PATH_INFO: `/v3/users/410a0f3f79474e1bb6cf4af9b84f555f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.495375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] RBAC: Authorizing `identity:get_user(user_id=410a0f3f79474e1bb6cf4af9b84f555f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:30.497388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:30.499445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 164/315] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:30 2022] GET /identity/v3/users/410a0f3f79474e1bb6cf4af9b84f555f => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:30.505238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:30.560764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:30.615520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb346fb-1c52-4b10-8169-5e09fc37f55e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.650215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.650858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.651143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.651423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.723704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:30.725221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:30.775834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:30.836626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 152/316] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:30.838891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:30.946667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3744a64-d458-4cb5-a689-90391d4344ea None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:30.983219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e109-f5ba-4046-8ecd-873751800080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:30.984072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e109-f5ba-4046-8ecd-873751800080 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:30.984354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e109-f5ba-4046-8ecd-873751800080 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:30.984671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e109-f5ba-4046-8ecd-873751800080 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:30.985909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961e109-f5ba-4046-8ecd-873751800080 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:30.987375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961e109-f5ba-4046-8ecd-873751800080 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:30.989083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 165/317] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:30 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:30.994876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:31.104980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16787399-7bc2-4801-8646-3485f5a2800b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:31.141010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:31.142237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:31.142753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:31.143227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:31.144267 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] RBAC: Adding query filter params (role.id=fa34a652ebf044bdbaebad9d1981eec8, scope.project.id=13ee90153ae24027b221573ef43bb009, user.id=410a0f3f79474e1bb6cf4af9b84f555f) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:31.144783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:31.146473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de89a84-7234-4b4a-b117-3acc0701aa4c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:31.153859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 153/318] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:30 2022] GET /identity/v3/role_assignments?user.id=410a0f3f79474e1bb6cf4af9b84f555f&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=fa34a652ebf044bdbaebad9d1981eec8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:31.674870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad834f-b7b9-416b-819a-d0715ae2c40b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:31.675244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad834f-b7b9-416b-819a-d0715ae2c40b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:31.675422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad834f-b7b9-416b-819a-d0715ae2c40b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:31.676949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 166/319] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:31.681854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:31.682302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:31.682482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:31.700179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:31.701349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:31.703392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:31.770693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 154/320] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:31.795437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad834f-b7b9-416b-819a-d0715ae2c40b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:31.848425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:31.897085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad834f-b7b9-416b-819a-d0715ae2c40b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:31.931302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ac714-2e5d-44b3-b274-bae446f7f56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:31.932022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac714-2e5d-44b3-b274-bae446f7f56d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:31.932303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac714-2e5d-44b3-b274-bae446f7f56d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:31.932574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ac714-2e5d-44b3-b274-bae446f7f56d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:31.942754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ac714-2e5d-44b3-b274-bae446f7f56d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-7f8ac714-2e5d-44b3-b274-bae446f7f56d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:31.950864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:31.951760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:31.952615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 167/321] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:31.959113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.005004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1d65-ba1d-4710-a6d0-5f27ff49f49c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.005299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1d65-ba1d-4710-a6d0-5f27ff49f49c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.005580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b1d65-ba1d-4710-a6d0-5f27ff49f49c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.007120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 168/322] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:32.011893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.012189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.012570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.030377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:32.031586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:32.064464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58000c6d-06e4-40d0-a8a5-ef5b7b9f78ea None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.110149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 169/323] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:32.114004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.114679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.114961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.115236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.115988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:32.116295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:32.117693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:32.123404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.127673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 155/324] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:32.132816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.132941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.215441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.273542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67b07-14a5-4660-a662-6146b1b11888 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.273926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63f146-7d3d-4afe-a0c9-536007ea1a28 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.309044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.309425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.309884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.310170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.310266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.310444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] PATH_INFO: `/v3/users/dcc5edb3d2dd4b64b0e397aebfc00458` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.310537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.310789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.311639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc5edb3d2dd4b64b0e397aebfc00458)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:32.311961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:32.313156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:32.313408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:32.314825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 156/325] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:32 2022] GET /identity/v3/users/dcc5edb3d2dd4b64b0e397aebfc00458 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:32.319626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 170/326] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:32.320430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.320532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.394638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.427690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec943e-9bc7-408b-aa82-b0ccd0d2c8dc None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.431958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac8d1e-1a82-459e-8f23-9a430fac63d4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.440100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.466142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.466742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.467022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.467295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] PATH_INFO: `/v3/groups` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.467981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:32.469472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:32.479500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.480188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.482398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.482398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.482398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] RBAC: Adding query filter params (role.id=dee54d96dbc846328f01f51027d2178f, user.id=dcc5edb3d2dd4b64b0e397aebfc00458, scope.system=all) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:32.482618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:32.484035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaea92-18d2-4151-8706-4e90067993b9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:32.496189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 157/327] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jun 20 12:03:32 2022] GET /identity/v3/role_assignments?user.id=dcc5edb3d2dd4b64b0e397aebfc00458&scope.system=all&role.id=dee54d96dbc846328f01f51027d2178f => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:32.536303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089968d-227f-4119-a47c-80e9896e6f93 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.536577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089968d-227f-4119-a47c-80e9896e6f93 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.536853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089968d-227f-4119-a47c-80e9896e6f93 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.538272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 158/328] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:32.544836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.545124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.545435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.557539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 171/329] 10.222.0.64 () {60 vars in 1134 bytes} [Mon Jun 20 12:03:32 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:32.563909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:32.568055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:32.647873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 159/330] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:32.672168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.780600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6c47-9a4d-4659-9d42-33d7cce06234 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.816424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.817229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.817514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.817787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.829263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:32.837169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:32.838094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:32.839151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 172/331] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:32.844982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:32.905609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:32.960719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82068dc8-7bf3-47f1-9170-2f13b40a78a0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:32.996296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:32.996972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:32.997254 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:32.997533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:32.998318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:32.998628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:33.000027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:33.009190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 160/332] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:33.015262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:33.051651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:33.134259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762b2e3-f5ec-4037-b137-82ae73c1a46c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:33.172798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e51598-b94b-426c-8aa1-468a758cf8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:33.173739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51598-b94b-426c-8aa1-468a758cf8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:33.174054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51598-b94b-426c-8aa1-468a758cf8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:33.174325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e51598-b94b-426c-8aa1-468a758cf8d4 None admin] PATH_INFO: `/v3/users/f7a9b6aee11a4488ba53aef87962b6e0` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:33.175620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e51598-b94b-426c-8aa1-468a758cf8d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f7a9b6aee11a4488ba53aef87962b6e0)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:33.177128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e51598-b94b-426c-8aa1-468a758cf8d4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:33.179166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 173/333] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:33 2022] GET /identity/v3/users/f7a9b6aee11a4488ba53aef87962b6e0 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:33.185313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:33.295542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35cf0b-8ff5-4976-b73a-2c330f6f642a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:33.313855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:33.330952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2ee12-b5ff-4c94-b5f3-80327102effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:33.331905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2ee12-b5ff-4c94-b5f3-80327102effd None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:33.332193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2ee12-b5ff-4c94-b5f3-80327102effd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:33.332475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2ee12-b5ff-4c94-b5f3-80327102effd None admin] PATH_INFO: `/v3/system/users/f7a9b6aee11a4488ba53aef87962b6e0/roles/fa34a652ebf044bdbaebad9d1981eec8` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:33.333994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2ee12-b5ff-4c94-b5f3-80327102effd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f7a9b6aee11a4488ba53aef87962b6e0, role_id=fa34a652ebf044bdbaebad9d1981eec8)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:33.335397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2ee12-b5ff-4c94-b5f3-80327102effd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:33.413700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 161/334] 10.222.0.64 () {58 vars in 1334 bytes} [Mon Jun 20 12:03:33 2022] PUT /identity/v3/system/users/f7a9b6aee11a4488ba53aef87962b6e0/roles/fa34a652ebf044bdbaebad9d1981eec8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:34.851125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1658d4-8df9-4e93-9047-8084b4d7f6c2 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:34.851645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1658d4-8df9-4e93-9047-8084b4d7f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:34.851645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1658d4-8df9-4e93-9047-8084b4d7f6c2 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:34.853300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 174/335] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:34.859083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:34.859545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:34.859735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:34.878485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:34.879683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:34.963668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 162/336] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:35.007492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1658d4-8df9-4e93-9047-8084b4d7f6c2 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:35.146597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:35.155395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1658d4-8df9-4e93-9047-8084b4d7f6c2 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:35.198536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:35.199871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.200160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.200536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.214762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:35.223288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:35.224178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:35.225411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 175/337] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:35.230619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:35.346526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517177c-e402-4cb6-bd35-46c9184ebc2f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:35.372647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:35.399629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:35.400231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.400519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.400807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.401575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:35.401928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:35.403464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdc0a0-bd6e-44dd-b056-e7634bb3a9cf None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:35.413671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 163/338] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:35.420277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:35.553762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8609f6a-b093-4ec0-b3a2-7424752bd46d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:35.571864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4fb22-dcaa-4a31-ae87-fb56b1d663bd None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.572497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4fb22-dcaa-4a31-ae87-fb56b1d663bd None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.572982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4fb22-dcaa-4a31-ae87-fb56b1d663bd None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.575043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 164/339] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:35.582991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01041c5-2782-4c02-bcd9-cca2dec218d0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.583555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01041c5-2782-4c02-bcd9-cca2dec218d0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.584034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01041c5-2782-4c02-bcd9-cca2dec218d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.595995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:35.597557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.597868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.598158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.609094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c01041c5-2782-4c02-bcd9-cca2dec218d0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:35.610663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c01041c5-2782-4c02-bcd9-cca2dec218d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:35.658015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:35.731763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 165/340] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:35.735311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9ffa-7b9a-4ff8-8eaa-1c2595cb460e None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.735761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9ffa-7b9a-4ff8-8eaa-1c2595cb460e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.736203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9ffa-7b9a-4ff8-8eaa-1c2595cb460e None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.737931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 166/341] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:35.742642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:35.743097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:35.743518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:35.747393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:35.749191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:35.764627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:35.767556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:35.901051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 167/342] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:35.905375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:35.908376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 176/343] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:35.915483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:35.967580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:35.992919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:36.048559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac396a4-4c8a-47a1-9035-fc3428300964 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.081663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26967c8-6f24-43e8-91f7-c4cfce8f4884 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.112918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.114194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.114624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.115041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.117897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:36.119533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:36.124389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 177/344] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:35 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:36.126785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.170231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.171465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.171915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.172347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.193546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:36.202542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:36.213405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:36.215033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:36.215854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 168/345] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:36.216220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.292771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777b90f-a692-4d85-8f01-af60fab59987 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.348341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:36.364880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:36.368793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.369833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.370284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.370712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.377134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a549b-d61f-4682-9805-e78cca115e46 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.395538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:36.410291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:36.411321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:36.412215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 178/346] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:36.412955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.416343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85341f-7382-4365-ac91-803629409373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.417336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85341f-7382-4365-ac91-803629409373 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.417612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85341f-7382-4365-ac91-803629409373 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.418531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85341f-7382-4365-ac91-803629409373 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.428578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85341f-7382-4365-ac91-803629409373 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:36.431141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85341f-7382-4365-ac91-803629409373 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:36.437826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 169/347] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:36.437826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85341f-7382-4365-ac91-803629409373 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.566732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85341f-7382-4365-ac91-803629409373 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.609094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.610089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.610849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.611142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.612219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:36.612532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:36.614225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:36.617604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27dd49-68d7-4c0d-8208-d7e184b85072 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.627724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 170/348] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:36.628809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.659170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:36.689184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.690167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.691875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.692318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.694722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:36.695208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:36.699817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:36.716132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 179/349] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:36.718946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.819972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6c968-fee5-474d-8315-2990549acb4a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:36.831126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:36.868581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:36.869856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:36.870331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:36.872024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:36.873055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=2a1721e348644e499179fd00d5540e1e) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:36.873533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:36.875532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:36.884327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 171/350] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dee54d96dbc846328f01f51027d2178f => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:36.885389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:36.953320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72909af-43dc-4d47-bc98-928636a33241 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:37.003450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3b51-0a34-4654-b275-f7547f824319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:37.003450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3b51-0a34-4654-b275-f7547f824319 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.003739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3b51-0a34-4654-b275-f7547f824319 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.004007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3b51-0a34-4654-b275-f7547f824319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.007711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.030565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ad7e-c86c-48eb-99d3-db0e2b5b5f56 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:37.082388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:37.082810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.083200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.083608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.102316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3b51-0a34-4654-b275-f7547f824319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:37.103603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3b51-0a34-4654-b275-f7547f824319 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:37.161348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.178964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:37.180802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:37.241385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 180/351] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:37.242710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59bfea-01c7-4657-8075-1c4b586ba3ac None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.243001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59bfea-01c7-4657-8075-1c4b586ba3ac None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.243281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59bfea-01c7-4657-8075-1c4b586ba3ac None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.244822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 181/352] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:37.250992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ad28e-5360-49d1-827e-cdd712f7f0dd None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.251332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ad28e-5360-49d1-827e-cdd712f7f0dd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.251616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ad28e-5360-49d1-827e-cdd712f7f0dd None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.253390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 182/353] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:37.254593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d0de3-97bb-4d66-88cf-e3a1f53e6ac4 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.255812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d0de3-97bb-4d66-88cf-e3a1f53e6ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.255812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d0de3-97bb-4d66-88cf-e3a1f53e6ac4 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.260614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 183/354] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:37.260614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521226f-cf54-45a4-8587-6041ee8a87e7 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.260614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521226f-cf54-45a4-8587-6041ee8a87e7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.260614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521226f-cf54-45a4-8587-6041ee8a87e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.278065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9521226f-cf54-45a4-8587-6041ee8a87e7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:37.279916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9521226f-cf54-45a4-8587-6041ee8a87e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:37.303378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.326380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 172/355] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:37.327313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:37.370702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 184/356] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:37.373038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a469dc-af4b-419e-83b8-694618642773 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.373536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a469dc-af4b-419e-83b8-694618642773 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.374063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a469dc-af4b-419e-83b8-694618642773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.392639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-77a469dc-af4b-419e-83b8-694618642773 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:37.395026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-77a469dc-af4b-419e-83b8-694618642773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:37.457672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6677b-2828-4aef-91f4-db1afe34ffe0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:37.478731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 185/357] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:37.487303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.487606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.487878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.498517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:37.499611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.500064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.500525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.501989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:37.503680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:37.505631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 173/358] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:37 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:37.506600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:37.507853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:37.509094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:37.512047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.580743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.600554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 186/359] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:37.601730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:37.647227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26601ce5-f97f-41f4-ab94-a8d36ab39183 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:37.699323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:37.700242 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.700530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.700808 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.702133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:37.703745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:37.706147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 174/360] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:37 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:37.707161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:37.737106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184d928-fc8e-4085-899b-6525ac78e085 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:37.789473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:37.790506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.790881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.791166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.806143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.810178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:37.820513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:37.837172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 187/361] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:37.838014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:37.844635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e828433-4fd4-4c53-8c9f-6d96af8f69d7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:37.870051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:37.885741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:37.887214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:37.887674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:37.887963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:37.889396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:37.890894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:37.892568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 175/362] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:37 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:37.893326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:37.964481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8dc1-1f26-411e-96d6-36d711bbb7cc None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.008674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.009541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.009859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.010139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.023120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:38.025780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311531-fbd2-4848-bf49-985bc3314b1b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:38.033723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:38.034725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:38.035561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 188/363] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:38.036249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.067064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.067799 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.068086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.068366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.090234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:38.101646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:38.102734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:38.103552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:38.106886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 176/364] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:38.106886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.124096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.180190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.184075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157265-360a-4782-a400-6f77f264c092 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.229400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.232269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.232711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.233023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.234427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.236487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.237710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 189/365] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.240713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.250590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32b40c-3408-426d-93f1-931272e3f85a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.300592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.301382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.301758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.302144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.302965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:38.303436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.304839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.313938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 177/366] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.314652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.374788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d8ce-cfb0-4879-b7ce-8d689d3f015c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.404158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.415444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.419938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.419938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.419938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.419938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=2a1721e348644e499179fd00d5540e1e) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:38.419938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.420737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.427598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 190/367] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.428198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.442641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d223a3-b2ef-4559-b7d7-48e86010f795 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.455196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.505177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.505177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.505177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.505177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.506961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:38.507178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.508625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.525934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 178/368] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.529559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.585552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4484790-7d98-4c6e-9ff2-b9d76d479a9b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.628081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.628673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.628953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.629314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.630798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:38.631108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.632756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.642802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 191/369] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.643455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.676100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f18820-1ea8-4342-9983-b09694e188dd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.708616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.714658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.715677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.716172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.716680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.717723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=13ee90153ae24027b221573ef43bb009) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:38.718356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.720031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.726142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 179/370] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dee54d96dbc846328f01f51027d2178f => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.727414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.764514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118c0c-6e6c-4b44-86c8-29c7904915db None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.770951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:38.803890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.804560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.804847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.805127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.845202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e2d34-5f25-4bf4-b46e-6faa3b19cd5a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:38.882361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:38.883695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:38.884202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:38.884700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] PATH_INFO: `/v3/users/f7a9b6aee11a4488ba53aef87962b6e0` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:38.884806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.886405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.886673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] RBAC: Authorizing `identity:get_user(user_id=f7a9b6aee11a4488ba53aef87962b6e0)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:38.888354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:38.891368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 180/371] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/users/f7a9b6aee11a4488ba53aef87962b6e0 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:38.892385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:38.954948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.006571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63432e-a1cb-4b27-84aa-d2064146fb8f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.010188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.017837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 192/372] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:39.018663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.048654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.050048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.050557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.051038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.130438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.131948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.152693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfa67b-0689-4f00-a4b7-531157821777 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.228916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.229640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.229974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.230428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.231509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] RBAC: Adding query filter params (role.id=fa34a652ebf044bdbaebad9d1981eec8, user.id=f7a9b6aee11a4488ba53aef87962b6e0, scope.system=all) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:39.231622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.233048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.265842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 193/373] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/role_assignments?user.id=f7a9b6aee11a4488ba53aef87962b6e0&scope.system=all&role.id=fa34a652ebf044bdbaebad9d1981eec8 => generated 510 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:39.265842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.294134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.303067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 181/374] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:39.310302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.313994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.440321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9bcfc7-2f7c-42c1-8e60-64cd7d2cc51e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.485311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c347e12-9ceb-440f-940d-e958262d8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.487576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c347e12-9ceb-440f-940d-e958262d8c53 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.488072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c347e12-9ceb-440f-940d-e958262d8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.488571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c347e12-9ceb-440f-940d-e958262d8c53 None admin] PATH_INFO: `/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.490098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c347e12-9ceb-440f-940d-e958262d8c53 None admin] RBAC: Authorizing `identity:get_project(project_id=1f7b8b3cd4a74f7eb74d84f735aad86f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.491766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c347e12-9ceb-440f-940d-e958262d8c53 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.493717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 182/375] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:39.496740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14157-dd64-466a-8768-055298738d5c None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.497277 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14157-dd64-466a-8768-055298738d5c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.497754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c14157-dd64-466a-8768-055298738d5c None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.499710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 183/376] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:39.501171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c14157-dd64-466a-8768-055298738d5c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.541425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2aa89-aa0c-4080-bf9d-04d0b38a362a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.592227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8b1bc-f365-43cd-9f9a-18d809637a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.593117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8b1bc-f365-43cd-9f9a-18d809637a93 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.593400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8b1bc-f365-43cd-9f9a-18d809637a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.593680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8b1bc-f365-43cd-9f9a-18d809637a93 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.594949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8b1bc-f365-43cd-9f9a-18d809637a93 None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.596136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.596410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8b1bc-f365-43cd-9f9a-18d809637a93 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.603742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 194/377] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:39.603742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.603742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.603742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.624381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:39.625750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:39.646854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c14157-dd64-466a-8768-055298738d5c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.694394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.696236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.696670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.697103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] PATH_INFO: `/v3/groups/d23a08ec11664984b7328f0ea41a3682` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.704998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] RBAC: Authorizing `identity:get_group(group_id=d23a08ec11664984b7328f0ea41a3682)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.706870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.708770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 184/378] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/groups/d23a08ec11664984b7328f0ea41a3682 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:39.709881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.714220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 195/379] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:39.716621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.733218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:39.846256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600a9ca-f2bd-4aa6-92fe-ab77387dcdfb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.849643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15f7fc-1118-4b78-8cdd-af27be3ca253 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:39.891991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.892400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:39.893148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.893509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.893762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:39.893886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.894327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:39.894793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:39.894892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] RBAC: Adding query filter params (group.id=d23a08ec11664984b7328f0ea41a3682, role.id=257fc562d022442fb5494f80168760bb, scope.project.id=1f7b8b3cd4a74f7eb74d84f735aad86f) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:39.895279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.896526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:39.897060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.898373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:39.901439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 185/380] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:39.902618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.908939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 196/381] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/role_assignments?group.id=d23a08ec11664984b7328f0ea41a3682&scope.project.id=1f7b8b3cd4a74f7eb74d84f735aad86f&role.id=257fc562d022442fb5494f80168760bb => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:39.909824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:39.913235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:40.004925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:40.047580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c3c6b-d761-4d83-814f-a4fefec5ce2d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:40.049073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06f76c-a03b-4616-8d00-c11edbfd4407 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:40.102546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:40.103233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:40.103521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:40.103801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:40.105084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:40.106573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:40.106853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:40.107131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:40.108069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=13ee90153ae24027b221573ef43bb009) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:40.108389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:40.110133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:40.124602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 197/382] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:40.135025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:40.144064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:40.145069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:40.146831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 186/383] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:40.151953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:40.282901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa54914-434d-48a5-ba33-f5240b069a79 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:40.331843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:40.332531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:40.332822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:40.333105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:40.333887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:40.334202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:40.335606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:40.337991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:40.346306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 198/384] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:40.351708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:40.441136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:40.495548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13bc73-1978-4d7d-81c2-f698447dff00 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:40.545142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:40.546040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:40.546329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:40.546610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:40.547829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:40.550983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:40.555452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 187/385] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:40 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:40.563375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:40.712446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd3bd2-a6d9-4651-94d2-e655502f65d0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:40.757189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e5feb-1196-4843-9077-90ebd8368602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:40.758087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5feb-1196-4843-9077-90ebd8368602 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:40.758370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5feb-1196-4843-9077-90ebd8368602 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:40.758643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5feb-1196-4843-9077-90ebd8368602 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:40.759835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e5feb-1196-4843-9077-90ebd8368602 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:40.761362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e5feb-1196-4843-9077-90ebd8368602 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:40.764079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 199/386] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:40 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:40.770870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:40.940216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da72cb-148e-4cfa-baa8-0abeb0de6b29 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:40.983131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:40.994888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa8a84-e739-40a0-b7cb-38a26a1832cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:40.996313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8a84-e739-40a0-b7cb-38a26a1832cd None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:40.997971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8a84-e739-40a0-b7cb-38a26a1832cd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:40.997971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa8a84-e739-40a0-b7cb-38a26a1832cd None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.002600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa8a84-e739-40a0-b7cb-38a26a1832cd None admin] RBAC: Authorizing `identity:create_grant(project_id=2a1721e348644e499179fd00d5540e1e, group_id=167d0e0ef9ab4beea4fbeb20ce79db85, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:41.004089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa8a84-e739-40a0-b7cb-38a26a1832cd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:41.078471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 188/387] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jun 20 12:03:40 2022] PUT /identity/v3/projects/2a1721e348644e499179fd00d5540e1e/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:41.138456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca54883-2731-4922-aa6e-cf6b3485badd None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:41.139075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca54883-2731-4922-aa6e-cf6b3485badd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:41.139075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca54883-2731-4922-aa6e-cf6b3485badd None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.140422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 200/388] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:41.146537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:41.146886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:41.147178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.172037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:41.173314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:41.281179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 189/389] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:41.303965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca54883-2731-4922-aa6e-cf6b3485badd None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:41.396756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:41.443431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca54883-2731-4922-aa6e-cf6b3485badd None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:41.489348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29088f32-eb18-4189-a9dc-91e98b4b2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:41.490247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088f32-eb18-4189-a9dc-91e98b4b2ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:41.490534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088f32-eb18-4189-a9dc-91e98b4b2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:41.490811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29088f32-eb18-4189-a9dc-91e98b4b2ef1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.510787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29088f32-eb18-4189-a9dc-91e98b4b2ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-29088f32-eb18-4189-a9dc-91e98b4b2ef1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:41.519598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:41.521831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:41.523829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 201/390] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:41.527514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:41.597499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd40ff-ca08-41b4-aadd-f764cf97db6d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:41.597851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd40ff-ca08-41b4-aadd-f764cf97db6d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:41.598087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd40ff-ca08-41b4-aadd-f764cf97db6d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.599751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 202/391] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:41.607802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:41.608178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:41.608472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.639183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:41.640401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:41.715433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2c65-3c4c-44d0-9df2-6efd711756c3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:41.760652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 203/392] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:41.771393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:41.787161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:41.792022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:41.792833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:41.793154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:41.793427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:41.794344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:41.794657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:41.796053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:41.812382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 190/393] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:41.818052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:41.909577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:41.961756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0f663-8726-43d0-9d3e-3d496305f8ee None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:41.962066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54c05-b17f-4446-871c-7462ab3a5335 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.006537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.007750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.008210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.008657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.010052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.012667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.015011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 191/394] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:41 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:42.022413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:42.035835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.036642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.036923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.037193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.055684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:42.065092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:42.066025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:42.066848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:42.085720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 204/395] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:42.092129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:42.149881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:42.208695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ebaf8-b22d-4e2e-acf3-8c1688483cb7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.242254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:42.246840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.247517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.248050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.248325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.254364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:42.254694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.256122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.264444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e624a-7354-430c-95e7-9ca6f3b6bad7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.276170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 205/396] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:42.283167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:42.308269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.309936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.310442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.310937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.312332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.314080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.316283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 192/397] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:42 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:42.323034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:42.469355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5aca9a-3631-4081-9fb5-df912c1337f0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.504911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.505772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.506082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.506355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.507886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.509405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.511414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 206/398] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:42 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:42.516917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:42.535926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7c57a-ca0d-41ce-b3b0-3af5dcc270bd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.575235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:42.601251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:42.639528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b2ccf-60c7-41be-bee9-3d6d59a88543 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.640095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c6644-80ce-42a0-9eda-f4906f9880f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.641070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c6644-80ce-42a0-9eda-f4906f9880f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.641373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c6644-80ce-42a0-9eda-f4906f9880f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.646205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c6644-80ce-42a0-9eda-f4906f9880f6 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.651121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c6644-80ce-42a0-9eda-f4906f9880f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a1721e348644e499179fd00d5540e1e, group_id=167d0e0ef9ab4beea4fbeb20ce79db85, role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.652703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c6644-80ce-42a0-9eda-f4906f9880f6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.678218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4b2b-df24-4030-8892-957d0069c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.679218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4b2b-df24-4030-8892-957d0069c5bc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.679477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4b2b-df24-4030-8892-957d0069c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.679774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4b2b-df24-4030-8892-957d0069c5bc None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.680977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4b2b-df24-4030-8892-957d0069c5bc None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.682473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4b2b-df24-4030-8892-957d0069c5bc None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.684884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 207/399] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:42 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:42.689903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569627b-5507-46d0-a927-22c2f4cb21a3 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.689903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569627b-5507-46d0-a927-22c2f4cb21a3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.689903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569627b-5507-46d0-a927-22c2f4cb21a3 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.689903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 208/400] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:42.694309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569627b-5507-46d0-a927-22c2f4cb21a3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:42.721903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 193/401] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jun 20 12:03:42 2022] PUT /identity/v3/projects/2a1721e348644e499179fd00d5540e1e/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dec207b48f6f4beb9cc4250b08307111 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:42.723588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f3918-3ea8-4990-aa63-8e2c8b0bbd95 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.724071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f3918-3ea8-4990-aa63-8e2c8b0bbd95 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.724418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f3918-3ea8-4990-aa63-8e2c8b0bbd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.744769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-662f3918-3ea8-4990-aa63-8e2c8b0bbd95 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:42.746795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-662f3918-3ea8-4990-aa63-8e2c8b0bbd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:42.834557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569627b-5507-46d0-a927-22c2f4cb21a3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:42.839240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 194/402] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:42.839240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28c2b-b1bf-48f6-a50d-02b54f1186bf None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.839240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28c2b-b1bf-48f6-a50d-02b54f1186bf None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.839240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28c2b-b1bf-48f6-a50d-02b54f1186bf None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.839240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 195/403] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:42.844712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.845006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.847956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.872236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:42.872236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:42.878107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:42.909520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:42.910026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:42.910313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:42.910589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:42.912692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] RBAC: Authorizing `identity:create_grant(project_id=13ee90153ae24027b221573ef43bb009, group_id=167d0e0ef9ab4beea4fbeb20ce79db85, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:42.916182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:42.958680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 196/404] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:42.959531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.008101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:43.016018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 209/405] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jun 20 12:03:42 2022] PUT /identity/v3/projects/13ee90153ae24027b221573ef43bb009/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:03:43.017252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.138546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36825323-6253-4fce-a2dc-ee72b58deecc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.219419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.222573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.222573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.222573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.235712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:43.237883 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d391c-cb75-472d-92ed-2c28f18874cd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:43.244634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:43.246346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:43.247659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 197/406] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:43.251959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.285703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.286953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.287464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.287933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.300681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:43.310219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:43.311135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:43.312025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:43.314882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 210/407] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:43.323099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.364141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:43.367081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db7ec7-9cf3-4f7c-b964-2f743683af79 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.386224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:43.419374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.420070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.420361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.420641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.421406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:43.421721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:43.423142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:43.432248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 198/408] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:43.438849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.519955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94894d-3dea-4299-a84c-e80669e8afb9 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.560874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba279b8-51b2-4bdb-95f1-e7641230f09e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.599400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.600884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.601372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.601867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] PATH_INFO: `/v3/groups/d23a08ec11664984b7328f0ea41a3682` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.603985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] RBAC: Authorizing `identity:get_group(group_id=d23a08ec11664984b7328f0ea41a3682)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:43.606647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:43.608821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 199/409] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/groups/d23a08ec11664984b7328f0ea41a3682 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:43.611132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.611805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.612148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.612431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.613247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:43.613565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:43.615410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.626479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ccabf-b66b-4d37-a780-a06e6ddfc96d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:43.640701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 211/410] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:43.642076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83a18-410f-4a06-899c-a7e89872239d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.642367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83a18-410f-4a06-899c-a7e89872239d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.642645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83a18-410f-4a06-899c-a7e89872239d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.644042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 212/411] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:43.649028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.649310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.649594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.662160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:43.670760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:43.672315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:43.728891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbaaa97-b82b-46f7-bffc-4a7adc167c57 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.753814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 213/412] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:43.754754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.782663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.783715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.784066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.784353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:43.784464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] PATH_INFO: `/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.790389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] RBAC: Authorizing `identity:get_project(project_id=1f7b8b3cd4a74f7eb74d84f735aad86f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:43.792006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:43.795241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 200/413] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:43.796209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.870272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b0c53-e97a-4a5b-952b-8affd559acb5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.905712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.906731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.907092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.907446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:43.908820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:43.910409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:43.912428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 214/414] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:43.913282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:43.924564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:43.930563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72a434-78de-4c6f-a40f-44d8ae19f46d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:43.983960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:43.984793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:43.985084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:43.985653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.001255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:44.011616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:44.012624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:44.013465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:44.017742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 201/415] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:44.018822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:44.031142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:44.043732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbd828-d5d6-4362-ac8d-66cc4ecd4d22 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:44.086739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:44.088189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:44.089085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:44.090149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] PATH_INFO: `/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f/groups/d23a08ec11664984b7328f0ea41a3682/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.092940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] RBAC: Authorizing `identity:create_grant(project_id=1f7b8b3cd4a74f7eb74d84f735aad86f, group_id=d23a08ec11664984b7328f0ea41a3682, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:44.095176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:44.143190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c975f01-2947-445f-8057-557b6077d18c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:44.178795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:44.179647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:44.179935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:44.180214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.181883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:44.183262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:44.187064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 215/416] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jun 20 12:03:43 2022] PUT /identity/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f/groups/d23a08ec11664984b7328f0ea41a3682/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:44.188711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:44.189708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 202/417] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:44 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:44.190625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:44.226689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:44.327465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189c9c2-8738-4c84-b436-f1e6a79a7dda None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:44.370322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:44.372035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:44.372539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:44.373004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.374069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] RBAC: Adding query filter params (name=member) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:44.374623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:44.376407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:44.386200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 216/418] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:44.391388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:44.396022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7482ae-dc3a-40f5-9f70-cc515fd0019f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:44.412122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:44.432913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:44.434075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:44.434452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:44.434633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.436977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] RBAC: Authorizing `identity:create_grant(project_id=13ee90153ae24027b221573ef43bb009, group_id=167d0e0ef9ab4beea4fbeb20ce79db85, role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:44.438488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:44.501207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 203/419] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jun 20 12:03:44 2022] PUT /identity/v3/projects/13ee90153ae24027b221573ef43bb009/groups/167d0e0ef9ab4beea4fbeb20ce79db85/roles/dec207b48f6f4beb9cc4250b08307111 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:03:44.506489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4c575-417f-4ac5-b140-b1c9bac68e95 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:44.550088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:44.551178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:44.551650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:44.552107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.629837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:44.631716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:44.652473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:44.743474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 217/420] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:44.749402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:44.852693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:44.872019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ad235-04b9-4d52-bd32-b8ecc43a5687 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:44.908703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415081f-92ae-4bb5-93f8-94f6af984390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:44.909992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415081f-92ae-4bb5-93f8-94f6af984390 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:44.910567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415081f-92ae-4bb5-93f8-94f6af984390 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:44.911181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415081f-92ae-4bb5-93f8-94f6af984390 None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:44.912521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415081f-92ae-4bb5-93f8-94f6af984390 None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:44.914121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415081f-92ae-4bb5-93f8-94f6af984390 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:44.916235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 204/421] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:44 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:44.922503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:45.034021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f475a7-4c3c-40eb-810f-36f5d607422e None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.034478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f475a7-4c3c-40eb-810f-36f5d607422e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.034887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f475a7-4c3c-40eb-810f-36f5d607422e None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.036557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 205/422] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:45.041584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.042021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.042540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.064002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd187436-2082-47f2-8080-13a38f5762d1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:45.068018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:45.069382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:45.099990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:45.131789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:45.132829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.133221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.134023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.137139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:45.139528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:45.144664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 218/423] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:44 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:45.154916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:45.207149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 206/424] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:45.240865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:45.319610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dfdfc-636a-4710-844c-3ea546c76192 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:45.384500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:45.385829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:45.386536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.386826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.387268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.388109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=2a1721e348644e499179fd00d5540e1e) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:45.388427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:45.389918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:45.401628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 219/425] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:45 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dee54d96dbc846328f01f51027d2178f => generated 611 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:45.412862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d8831-9333-4c71-8033-0fbed571b97f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:45.465743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e919a-26e9-4cd5-9e40-508aa83a0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:45.466523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e919a-26e9-4cd5-9e40-508aa83a0572 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.466812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e919a-26e9-4cd5-9e40-508aa83a0572 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.467095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e919a-26e9-4cd5-9e40-508aa83a0572 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.486023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e919a-26e9-4cd5-9e40-508aa83a0572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-370e919a-26e9-4cd5-9e40-508aa83a0572 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:45.494543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:45.497103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:45.498384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 207/426] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:45.502445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:45.549672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfb059-de14-43bb-823e-1228ca8756a3 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.549672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfb059-de14-43bb-823e-1228ca8756a3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.549672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfb059-de14-43bb-823e-1228ca8756a3 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.552089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 208/427] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:45.557007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.557658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.558916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.586600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:45.589167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:45.618651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:45.688076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f42be3-22f7-4334-bb98-0174df2b92f7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:45.698697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 209/428] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:45.728241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:45.731704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:45.732388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.732672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.733006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.733768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:45.734174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:45.735627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:45.748895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 220/429] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:45.754011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:45.847124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:45.879854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529424c-c9be-4c95-84fb-2d6ef6169a30 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:45.894663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8ee88-4ba7-4654-af92-97dae2392ef4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:45.908114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:45.926680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:45.928184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.928906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.929402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.937036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:45.938117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:45.938719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:45.939447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:45.944531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:45.954441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:45.955546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 12:03:45.956540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:45.959039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 210/430] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:45.966782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.034767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.036341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.110607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd940c-d662-40a4-ae66-2942cfe4d633 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.156433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.157348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.162701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.162701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.162701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:46.162701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.162701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.163378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:46.172308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 211/431] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:03:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:46.186788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 221/432] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:46.187491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.192346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.209319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:46.314141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc519-9e81-4b5a-aefb-3e384c0a5d6a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.325371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec294b-6c56-4c80-bec5-7925c9d21fd2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.367853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.368795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.369088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.369369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.378433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c88a5-3817-4692-b305-de22477058ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.379589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c88a5-3817-4692-b305-de22477058ce None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.380033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c88a5-3817-4692-b305-de22477058ce None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.380910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c88a5-3817-4692-b305-de22477058ce None admin] PATH_INFO: `/v3/projects/2a1721e348644e499179fd00d5540e1e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.382268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c88a5-3817-4692-b305-de22477058ce None admin] RBAC: Authorizing `identity:get_project(project_id=2a1721e348644e499179fd00d5540e1e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.384655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c88a5-3817-4692-b305-de22477058ce None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.387661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 222/433] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/projects/2a1721e348644e499179fd00d5540e1e => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:46.394419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c88a5-3817-4692-b305-de22477058ce None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.447030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:46.455436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.457104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.483593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:46.505554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c88a5-3817-4692-b305-de22477058ce None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.543159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.544069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.544353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.544628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.545838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.547368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.553833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 223/434] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:46.555041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.566142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 212/435] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:46.571301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.666224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed507ca-d44a-4742-87d9-ae1b0c264198 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.691227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:46.697188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae71fb5-d7dd-4ec3-8f1a-7896f4d5a940 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.703649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.704312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.704600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.704879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.705706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=2a1721e348644e499179fd00d5540e1e) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:46.706059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.707515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10816dbc-a76a-4f04-a2b0-84e7cf396b40 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.713681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 224/436] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=2a1721e348644e499179fd00d5540e1e&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:46.718673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635bb66-64db-44aa-8c93-208a260c0c0e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.718673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635bb66-64db-44aa-8c93-208a260c0c0e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.718673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635bb66-64db-44aa-8c93-208a260c0c0e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.718673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 225/437] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:46.726179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.726537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.726802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.741607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.742536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.742818 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.743094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.744335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.746525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.746858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:46.748092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:46.748774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 213/438] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:46.752992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:46.754115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.846058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 226/439] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:46.876619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.878281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a92dd-7206-41d2-b487-f4ccc063af4e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:46.919091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:46.919966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:46.920255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:46.920541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:46.922388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:46.924604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:46.925815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 214/440] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:46.931560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:46.971303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.008912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f7792-371e-441a-81b0-9ca3de9d29a7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.052279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.053093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.053534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.053847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.061735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe48e44-0cd7-4250-9478-aad33d187fe5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.069729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.074490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:47.085436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:47.086407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:47.087209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 227/441] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:47.092943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.106726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.107307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.107592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.107867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.108709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dee54d96dbc846328f01f51027d2178f, scope.project.id=13ee90153ae24027b221573ef43bb009) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:47.109018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.110570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38824a48-7892-490e-874e-175cdf58adbe None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.117127 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 215/442] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:46 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dee54d96dbc846328f01f51027d2178f => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:47.118937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8e462-72ed-49b6-be72-02aa85599a9c None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.119223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8e462-72ed-49b6-be72-02aa85599a9c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.119494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8e462-72ed-49b6-be72-02aa85599a9c None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.121980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 216/443] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:47.131590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.131882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.132160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.150447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:47.151726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:47.234480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 217/444] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:47.239181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beca92-63ea-4214-9b42-a6963a3e962f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.259999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.283106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.283781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.284062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.284342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.285080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:47.285389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.286889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.291236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.296952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 228/445] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:47.303529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.374108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.377139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48e71b-5f00-446b-9824-93115ef5cce7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.418470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.419295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.419583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.419860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.420865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193b33a-da83-47f1-9e83-685783c8ccbf None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.431913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:47.440794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:47.441717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:47.446238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 218/446] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:47.448171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.467522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.468269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.468649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.468965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.545958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.546776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.547434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.561178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2024d3c-c668-422a-943f-1b5691dab9b6 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.594581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.595251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.595541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.595823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.596576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:47.596888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.598319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.606946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 219/447] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:47.608143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.612474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.646756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 229/448] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:47.653268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.712193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a8c2-6d4a-4362-86c5-ebc88feb84a7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.744681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.745327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.746201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.746474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.751374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9ce1d-6bfc-4360-95fb-60c3fd9a89da None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.764384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.788318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.789185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.789502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.789782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] PATH_INFO: `/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.791005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] RBAC: Authorizing `identity:get_project(project_id=1f7b8b3cd4a74f7eb74d84f735aad86f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.792481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.794408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 230/449] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/projects/1f7b8b3cd4a74f7eb74d84f735aad86f => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:47.799754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.814779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.816249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.830932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:47.901313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afe274-0573-42a5-a640-eec66d7568fb None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:47.914871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 220/450] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:03:47.921087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.936180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:47.937044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:47.937332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:47.937612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] PATH_INFO: `/v3/groups/d23a08ec11664984b7328f0ea41a3682` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:47.938816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] RBAC: Authorizing `identity:get_group(group_id=d23a08ec11664984b7328f0ea41a3682)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:47.940255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:47.946850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 231/451] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/groups/d23a08ec11664984b7328f0ea41a3682 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:47.947724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:47.970577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:48.020968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0bc8f-aeec-4e68-be5d-e6b578da3dff None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:48.044918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:48.048854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f72073-e79c-4e1b-91e9-240c0cb5b68a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:48.057519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:48.058512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:48.058973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:48.059331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] PATH_INFO: `/v3/projects/13ee90153ae24027b221573ef43bb009` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:48.060769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] RBAC: Authorizing `identity:get_project(project_id=13ee90153ae24027b221573ef43bb009)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:48.062575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:48.064844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 221/452] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/projects/13ee90153ae24027b221573ef43bb009 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:48.070393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:48.086663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:48.087332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:48.087617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:48.087892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:48.088720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] RBAC: Adding query filter params (group.id=d23a08ec11664984b7328f0ea41a3682, role.id=257fc562d022442fb5494f80168760bb, scope.project.id=1f7b8b3cd4a74f7eb74d84f735aad86f) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:48.089034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:48.092319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:48.098199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 232/453] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:47 2022] GET /identity/v3/role_assignments?group.id=d23a08ec11664984b7328f0ea41a3682&scope.project.id=1f7b8b3cd4a74f7eb74d84f735aad86f&role.id=257fc562d022442fb5494f80168760bb => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:48.179395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecdd92-8190-42b0-b0d4-b928b30492fb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:48.197722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:48.216526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2ee96-c510-41f6-b7ec-58a16a144714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:48.217457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2ee96-c510-41f6-b7ec-58a16a144714 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:48.217742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2ee96-c510-41f6-b7ec-58a16a144714 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:48.218047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2ee96-c510-41f6-b7ec-58a16a144714 None admin] PATH_INFO: `/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:48.219300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2ee96-c510-41f6-b7ec-58a16a144714 None admin] RBAC: Authorizing `identity:get_group(group_id=167d0e0ef9ab4beea4fbeb20ce79db85)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:48.220782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2ee96-c510-41f6-b7ec-58a16a144714 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:48.222516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 222/454] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jun 20 12:03:48 2022] GET /identity/v3/groups/167d0e0ef9ab4beea4fbeb20ce79db85 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:03:48.228588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:48.330591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc4346-f181-4c6b-a681-700c4b404d5e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:48.364074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:48.364719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:48.365003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:48.365278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:48.366124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] RBAC: Adding query filter params (group.id=167d0e0ef9ab4beea4fbeb20ce79db85, role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=13ee90153ae24027b221573ef43bb009) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:48.366436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:48.367869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42102e6-f897-4630-b2c1-a719f28db087 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:48.373781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 233/455] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jun 20 12:03:48 2022] GET /identity/v3/role_assignments?group.id=167d0e0ef9ab4beea4fbeb20ce79db85&scope.project.id=13ee90153ae24027b221573ef43bb009&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:51.023267 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19ae05-2a87-489d-b17d-d07605db079a None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.024291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19ae05-2a87-489d-b17d-d07605db079a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.024787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19ae05-2a87-489d-b17d-d07605db079a None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.026819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 223/456] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:51.032086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879856-6d7d-4377-9243-71d32410f25e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.032909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879856-6d7d-4377-9243-71d32410f25e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.033403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb879856-6d7d-4377-9243-71d32410f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.055213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-eb879856-6d7d-4377-9243-71d32410f25e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:51.056751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-eb879856-6d7d-4377-9243-71d32410f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:51.086215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:51.144508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 234/457] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:51.185861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19ae05-2a87-489d-b17d-d07605db079a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:51.265415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dc3ff-2d8e-49fd-afb9-b911c33f0fb5 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.265767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dc3ff-2d8e-49fd-afb9-b911c33f0fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.266005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dc3ff-2d8e-49fd-afb9-b911c33f0fb5 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.267394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 235/458] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:03:51.296857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83e102-308f-4268-aa2b-539409631b37 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.297464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83e102-308f-4268-aa2b-539409631b37 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.298003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83e102-308f-4268-aa2b-539409631b37 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.303337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 236/459] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:51.303337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.303540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.303746 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.317876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19ae05-2a87-489d-b17d-d07605db079a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:51.321889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:51.323066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:51.358919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:51.359846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.364893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.364893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.372071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:51.373694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-220b45e0-12d2-4fb1-b942-5860c811a669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:51.395313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:51.399981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 224/460] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.400861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.409066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 237/461] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:51.410292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:51.422914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:51.424117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:51.460793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:51.513744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 225/462] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:51.514891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:51.544171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:51.565788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec11760-1492-4be5-9fce-1bc4942b8dfe None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:51.599043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:51.600093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.600559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.601009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.601951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:51.602436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:51.604077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:51.617962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 238/463] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:51.619214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:51.640141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78caf962-68d0-4db6-8503-bc6472f4a7bf None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:51.686475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:51.687771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.688437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.689266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.703373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:51.705067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:51.728041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:51.729126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:51.730339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:51.730339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:51.730339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:51.730339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:51.732089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 226/464] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:51.732723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:51.739641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056e9b8-c68c-4c89-832f-d9c8a1de3ac6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:51.755305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:51.778897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:51.780196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.780630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.781052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.793234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:51.795924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:51.803694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:51.817049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:51.818039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:51.818919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:51.818919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:51.818919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:51.818919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:51.821243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 239/465] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:51.822444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:51.852747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a4e25-4cd9-463d-be7e-ed9a4ac92bed None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:51.889889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:51.890578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.890851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.891130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.891844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:51.893299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:51.945218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995abd2a-0f8c-4c06-b1a1-8507b337dfd2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:51.980647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:51.981324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:51.981612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:51.981919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:51.982649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:51.982956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:51.984367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c7bd9-b03a-4407-b421-654ecee12378 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:51.985955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 227/466] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:51 2022] POST /identity/v3/users => generated 246 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:51.986853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.012530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 240/467] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:52.014418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb26f3e-faad-488f-a155-36fd4beaf578 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.014926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb26f3e-faad-488f-a155-36fd4beaf578 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.015436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb26f3e-faad-488f-a155-36fd4beaf578 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.017627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 241/468] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:52.018689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb26f3e-faad-488f-a155-36fd4beaf578 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.081727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:52.097289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:52.110615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1188-9eab-4c7c-a73e-0bce65e21fb0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.152494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb26f3e-faad-488f-a155-36fd4beaf578 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.154030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.155036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.155375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.155717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.157107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:52.157107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.158624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8605b0-e99b-432a-a41c-5e5ad3177d2e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:52.171826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 228/469] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:52.173193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.173490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.192685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:52.193915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:52.194903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.195609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.203694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.203694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.203694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.203694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:52.271009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 229/470] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:52.272166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.339317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:52.379723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f1183-00b2-422d-96f2-82ae76446c2c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.381562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 242/471] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:52 2022] POST /identity/v3/users => generated 248 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:52.383534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.429201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e46c-6b4d-4fd2-9092-57e14de5fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.430207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e46c-6b4d-4fd2-9092-57e14de5fe9b None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.430646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e46c-6b4d-4fd2-9092-57e14de5fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.431068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e46c-6b4d-4fd2-9092-57e14de5fe9b None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.431959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e46c-6b4d-4fd2-9092-57e14de5fe9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.434901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e46c-6b4d-4fd2-9092-57e14de5fe9b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:52.517541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53103de-77fe-4e35-8ecc-b9c3a0d74eb8 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.534901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 230/472] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:52 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:52.536741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b770262-62fd-4486-b476-be2c7024262b None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.537196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b770262-62fd-4486-b476-be2c7024262b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.537683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b770262-62fd-4486-b476-be2c7024262b None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.544453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:52.544612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 231/473] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:52.546496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.547026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.547528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.566094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.567091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.567429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.567714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.568155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:52.569678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:52.586732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.588570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:52.612749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:52.613685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:52.614649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:52.614649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:52.614649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:52.614649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:52.614649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 243/474] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:52.623025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.675022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 232/475] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:52.707402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.762692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18a3c2-a643-4645-9145-8c42e74e20c9 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.772707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:52.803096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.803761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.804047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.804324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.805050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:52.805360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.806771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:52.820813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 244/476] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:52.827385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.840253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1756d9-bbfa-4e15-a8e3-c1053d5f89d1 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.858557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:52.887102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.887713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.888001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.888285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.889345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.891348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:52.926803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.sql.core [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 12:03:52.926803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 12:03:52.926803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [parameters: {'id': '114cfd9afa654bd7a6e4c74f9915f139', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 12:03:52.926803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80466) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 12:03:52.947819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcc7c8-2fbe-45b4-bb81-fde9df027b8d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application result.read() Jun 20 12:03:52.950237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:03:52.951166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application yield resource Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise self.value Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application session.commit() Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 12:03:52.952077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self.session.flush() Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application compat.raise_( Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:03:52.952954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:03:52.954361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application result.read() Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:03:52.955823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [parameters: {'id': '114cfd9afa654bd7a6e4c74f9915f139', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:52.957248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 12:03:52.959361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:52.965186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 233/477] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jun 20 12:03:52 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:52.965186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:52.991277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:52.992049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:52.992408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:52.992760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:52.993546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:52.995866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:53.082153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 245/478] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:52 2022] POST /identity/v3/users => generated 249 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:03:53.103371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de669d6-8770-4945-9126-e4226f105115 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:53.120010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:53.143343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f2d94-86ba-429d-b92a-29d4434e274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:53.144153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f2d94-86ba-429d-b92a-29d4434e274a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:53.144443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f2d94-86ba-429d-b92a-29d4434e274a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:53.144732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f2d94-86ba-429d-b92a-29d4434e274a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:53.160199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f2d94-86ba-429d-b92a-29d4434e274a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-380f2d94-86ba-429d-b92a-29d4434e274a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:53.171116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:53.172091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:53.174380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 234/479] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:03:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:53.178317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:53.331542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:53.361166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c208cbb-600a-4502-9cda-5d9ac6e3c0f5 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:53.402087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:53.403100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:53.403584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:53.404062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:53.405281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:53.405825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:53.407504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1efa2a-b175-4bd2-8a43-83f5045d6e08 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:53.416410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 246/480] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:54.551979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7595b-cfba-4e76-a999-0eea83d6ef3f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:54.552478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7595b-cfba-4e76-a999-0eea83d6ef3f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:54.552552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7595b-cfba-4e76-a999-0eea83d6ef3f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:54.554214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 235/481] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:54.560014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0fb73-d900-4065-bd86-9b69453fb795 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:54.560424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0fb73-d900-4065-bd86-9b69453fb795 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:54.560610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0fb73-d900-4065-bd86-9b69453fb795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:54.585033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3ea0fb73-d900-4065-bd86-9b69453fb795 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:54.586443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3ea0fb73-d900-4065-bd86-9b69453fb795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:54.658521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 247/482] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:54.694302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7595b-cfba-4e76-a999-0eea83d6ef3f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:54.803122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7595b-cfba-4e76-a999-0eea83d6ef3f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:54.851597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:54.852765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:54.853245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:54.853853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:54.874671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:54.881910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074e5d-fcbb-4f0a-a360-b1c2f8a76b64 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:54.882208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074e5d-fcbb-4f0a-a360-b1c2f8a76b64 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:54.882490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96074e5d-fcbb-4f0a-a360-b1c2f8a76b64 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:54.883484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:54.884351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:54.885231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:54.886510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 248/483] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:54.888369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 236/484] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:54.893055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:54.893055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:54.893055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:54.894504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:54.911925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:54.913165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:54.958176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.049991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 249/485] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:03:55.062174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4561d-c9cb-4856-99d7-7cee7971d906 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.080933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.084061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.150054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.150740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.151019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.151345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.153732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:55.154074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:55.155730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:55.172675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 237/486] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:55.177581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.267882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c431ca1-efea-45de-adb4-a9db60ab6ffb None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.340752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.341476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.341758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.342060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.361684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:55.377020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:55.378001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:55.378827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:55.379439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.379511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 250/487] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:55.383448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705626f4-a28a-4a75-9ef1-4ba74865bbcf None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.387325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.420012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.420851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.421146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.421434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.432579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:55.434137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b0f73ddf-4b44-4e42-b2b8-38d30b27f00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:55.452034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:55.452956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:55.453852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:55.453852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:55.453852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:55.453852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:55.453852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 238/488] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:55.454933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2035-2735-4c30-86bc-ed5f54156ce1 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.455224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2035-2735-4c30-86bc-ed5f54156ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.455509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c2035-2735-4c30-86bc-ed5f54156ce1 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.455649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.460730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 239/489] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:55.462041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2035-2735-4c30-86bc-ed5f54156ce1 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.499008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e28cb4-b6c8-4d6f-8317-27826d5f2422 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.542939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.545384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.546034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.547307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.548693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:55.549737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:55.551516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7926ee4-101a-4064-b48c-cca1cf407489 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:55.564505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 251/490] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:55.566551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.566969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.567372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.585655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:55.587077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:55.603940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c2035-2735-4c30-86bc-ed5f54156ce1 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.647798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.648622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.649033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.649879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.650739 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:55.651540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:55.653327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:55.665487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 252/491] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:55.666659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.679008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 240/492] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:55.684629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.706075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.736307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.785854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6808a-67c9-4c8d-bb6d-38001d41e1d8 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.817921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de139d7-1c6c-42f9-8561-37a61f967505 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.822951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.823942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.824226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.824503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.835421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:55.836888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:55.858668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:55.859378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.859660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.859934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:55.860116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:55.860942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:55.866757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:55.866757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:55.866757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:55.866757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:55.866757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 253/493] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:55.866757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.876136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:55.878076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b216a006-fdba-4f8f-a8fe-292b4f00ea8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:03:55.894973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:55.895989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:03:55.896923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:55.901000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 241/494] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:03:55.902254 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210e537-77ff-4108-8026-ecec85809065 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:55.902553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210e537-77ff-4108-8026-ecec85809065 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:55.902836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210e537-77ff-4108-8026-ecec85809065 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:55.904165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 242/495] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:55.909106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210e537-77ff-4108-8026-ecec85809065 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:55.976757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9191b2-bf98-4929-9be6-86b7a0fb4066 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:55.981574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:55.987168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.014380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.015434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.016119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.016427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.022991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210e537-77ff-4108-8026-ecec85809065 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.027840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:56.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:56.037628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:56.038694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:56.041477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 254/496] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:56.042517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.069298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.070275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.071035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.071327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.072124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:56.072440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.074700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b615-5ad9-416c-b937-e1392f38b2ac None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.086786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 243/497] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:56.088047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.088343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.088626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.105786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:56.107046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:56.155976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a427b-20e5-4a02-be82-40e9eac4b9d2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.176153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 244/498] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:56.177210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.189914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.190585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.190881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.191176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.192050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:56.192360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.193791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.231129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 255/499] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:56.231973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.251438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.257688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.292557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de357c3-cb37-41ad-bb9b-3eadab2e9ed5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.326825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.327494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.328025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.328025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.328788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:56.329095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.330531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d502b-37d9-4f37-95ce-0e532e536261 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.330633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21354ac6-c417-498a-96c8-716e5f7f97fa None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.338417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 245/500] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:56.339709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543e23-797c-4e53-bde2-9bdf30728d9a None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.340010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543e23-797c-4e53-bde2-9bdf30728d9a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.340292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b543e23-797c-4e53-bde2-9bdf30728d9a None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.341576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 246/501] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:03:56.342316 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b543e23-797c-4e53-bde2-9bdf30728d9a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.369698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.371074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.371360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.371634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.378757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.380222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:03:56.396127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:56.397066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:56.398010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 256/502] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:56.398634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.450146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b543e23-797c-4e53-bde2-9bdf30728d9a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.470076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.482837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.484370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.485205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.485446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.485723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.496589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:03:56.498469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b79774-ba44-4d8d-bab5-035cf7cc8ffd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:03:56.504903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:56.505874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:56.506711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 247/503] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:56.507467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.535750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.536400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.536685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.536966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.605374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.607858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8072bb-1abe-4423-a47f-48581d6c4bfb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.608243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.640709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.641494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.641773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.642074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.653236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.654973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-ea4b7ce5-7722-4709-8244-aa8c0669ffb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:56.672563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:56.673446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:56.674343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:56.674343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:56.674343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:56.674343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:56.674343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 248/504] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:56.675068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.675375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.675650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.692673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:03:56.693871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:03:56.694802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.710485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 257/505] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:56.711246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.721407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.762745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 249/506] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:03:56.763855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.814700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790b763-ba5e-4da8-8212-9aa5ddcb47ef None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.849425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.850127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.850412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.850691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.851524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:56.851831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.853273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.875230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 258/507] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:56.875230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.875482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95053f-8627-4124-a8d1-285d49137dee None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:56.910952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:56.911610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:56.911894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:56.912226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:56.912962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:56.913318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:56.914762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:56.916474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.922994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 250/508] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:56.923807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:56.950265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:56.971852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fd0e1-118a-48ff-9b05-98a2d6599bbe None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.006365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.007019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.007299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.007571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.008282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:57.008585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.010058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.022315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 259/509] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:57.023109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.023866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cd55-1aca-4247-9b49-4fd30c331e04 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.059846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.060636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.060923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.061204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.071649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.073107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:57.091146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:57.092045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:57.092893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:57.092893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:57.092893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.092893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:57.092893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 251/510] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:57.093394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.130939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e59ec-9c63-4ced-a2a7-bc9a16ad9c3f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.133210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.164647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.166022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.166530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.167540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.171653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.180099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.181607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.194871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadadc94-2e08-4899-b858-b6a02d3540d2 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:57.199898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:57.200948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:57.202040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:57.202040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:57.202040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.202040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:57.202040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 260/511] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:57.202040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.235697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.236269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.236556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.236837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.301038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf972f-3f13-42fe-bd88-d9c7a060d2a8 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.303250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.304722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.335558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.336337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.336622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.336898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.348200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.349670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:57.366642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:57.367676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:57.368656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:57.368656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:57.368656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.368656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:57.368656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 261/512] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:57.369001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.380524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.383914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.407862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 252/513] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:57.408801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.470448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e5e07-e9b2-489b-be05-aa56e1f0574b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.503837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.504559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.504848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.505127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.506850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e988c1-7516-434e-840a-c3bdba0270c9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.513242 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.514729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:03:57.529049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:57.530287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 262/514] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:57.531469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.543950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.544616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.544904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.545184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.545951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:57.546264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.547671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.559247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 253/515] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:57.560038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.594883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.602792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.637564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e188-99c2-4163-b2a8-4bfb9f7ca541 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.661540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5734af3-558a-46ce-a8a0-a91432e7e342 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.671446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.672109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.672394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.672677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.673393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:57.673710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.675125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.687211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 263/516] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:57.687211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.694494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.695162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.695451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.695734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.696457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:57.696769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.698691 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.710748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 254/517] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:57.711558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.792440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926293f4-1e79-4374-832b-b60e5178e59c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.806814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.813160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e691b36-92f4-4657-af50-5a9a8c778d42 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.821851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:57.826866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.827657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.827944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.828216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.838026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.839540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.846304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.846975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.847264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.847980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:57.848497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:57.848898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:57.850373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:57.857264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:57.858311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:57.859239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:57.859239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:57.859239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:57.859239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:57.859239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 264/518] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:57.859239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.893634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 255/519] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:57.893634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:57.957944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c26e6f-d91e-42f7-aed3-579f285155a8 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.989214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb5bbf-a3b7-4d68-8eaa-bbb09aa61b31 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:57.991622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:57.992511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:57.992790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:57.993060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.000732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.002252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:03:58.017693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:58.018766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:58.019637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 265/520] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:58.020098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.030319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.031002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.031289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.031568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.032281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.033745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.061862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.120716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5af4c-23eb-476b-80a3-8447135f447f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.137974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 256/521] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:03:57 2022] POST /identity/v3/users => generated 247 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:03:58.138817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.154552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.166409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.167813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.168156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.168446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.177478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.179048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:03:58.195498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:58.200328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 266/522] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:58.201277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.259841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c6185-cfb5-4736-84ca-7cc29424cedd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.301973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.302950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.303234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.303519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.304250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:58.304561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.306006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.315874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.318825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8028ca7-2957-4a67-8b5c-5880e143e709 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.319445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 257/523] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:58.322475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.365658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.366355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.366645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.366928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.398780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.429818 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006d0a8-cdbb-4b23-8a3a-e1a5cf87d893 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.451057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.452852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.467949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.468612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.468895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.469173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.469983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:58.470296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.471724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.489552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 258/524] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:58.490410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.561330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.566091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 267/525] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:58.567083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.595450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453c865-cfb0-4ed2-bd51-5c62f4f7fef2 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.628195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.634508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.635186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.635474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.635996 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.636951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:58.637386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.639107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.670059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 259/526] 10.222.0.64 () {56 vars in 1139 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:58.670059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.674257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4c5e3-49a0-423e-9a29-82c86e5f8443 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.712221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.713019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.713303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.713582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.721078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.722558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:03:58.737056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:58.738006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:58.738896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 268/527] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:58.739978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.786837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba032b-b76f-41af-9895-e296b78cec89 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.798245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.824301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.824890 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.825176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.825456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.826329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=75c9161930b64f0e910a4a3323fa733a) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:58.826647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.828132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.834508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 260/528] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/role_assignments?user.id=75c9161930b64f0e910a4a3323fa733a&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:58.835303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.848649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63046068-a7ad-4218-b28a-c25b7b2c62cf None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:58.892060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:58.893381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:58.894074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:58.894572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:58.909098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:58.910492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:58.912377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:58.933178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:58.934193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:58.935064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:58.935064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:58.935064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:58.935064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:58.941761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 269/529] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:58.944163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:58.974474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5a80d-0724-4d4c-b41e-43f56f733caa None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.014750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.015404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.015688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.015963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.088776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d348c02-0e3c-49ee-98fe-0f01fc8aacbd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.102312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.104202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.106649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.124765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.125431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.125712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.126017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.126809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:59.127101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.128532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.148301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 270/530] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:59.149328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.168710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.228833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 261/531] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:03:59.230179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.254810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a67ecd-ffd3-4c98-93cd-3a3cf83562ca None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.291096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.292352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.292663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.293554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.294070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:59.294383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.295817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.313829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 271/532] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:59.313829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.346273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7555ab6-c706-4c86-982e-a40f18416a13 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.348285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.383627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.384669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.385156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.385660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.386781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=4761c5c956f84b15a76074531901c462) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:59.387296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.388969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.395106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 262/533] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/role_assignments?user.id=4761c5c956f84b15a76074531901c462&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:59.396322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.422250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.436434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ada30-c8f4-4582-a893-f6eb85aae926 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.513256 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.514502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.514997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.515473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.539020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.540678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.553071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58f54c-f1cf-42b0-b459-f94527345f7f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:03:59.570748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:59.571684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:59.577602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:03:59.577602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:03:59.577602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:03:59.577602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:03:59.577602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 272/534] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:59.581756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.615521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.616917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.617408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.617942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.630448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.631920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:03:59.651994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:03:59.652951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:03:59.653844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:03:59.659054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 263/535] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:03:59.659419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.721498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.739707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43c926-9861-4cfd-b775-e3807d4f03be None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.780332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.781354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.781859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.782356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.783892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:59.784414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.786017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.800822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 273/536] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:59.803868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:03:59.805982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:03:59.856422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77714c1e-6fdd-48a1-b056-caf0bfde0d80 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.943192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:03:59.943794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:03:59.944077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:03:59.944354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:03:59.945154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:03:59.945467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:03:59.946967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:03:59.969816 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 264/537] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:03:59.975877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6d698-bd49-41d3-98a7-9b64bb255f53 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:03:59.979097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:00.016008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:00.017216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.017705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.018241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.034821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:00.037323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:00.060848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:00.061772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:00.062648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:00.073738 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 274/538] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:00.083697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:00.092825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:00.180045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8435f8-d31f-4966-889e-4dfdbcf8d484 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:00.220936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:00.222004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.222509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.223167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.224195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=a20f362695fa4fbdb685632d4369bf04) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:00.224704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:00.226387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:00.234931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 265/539] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:03:59 2022] GET /identity/v3/role_assignments?user.id=a20f362695fa4fbdb685632d4369bf04&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:00.238148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:00.295123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a0c3-1b93-44a3-8e8c-a97724d512c0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:00.353138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:00.353831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.354134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.354459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.355284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:00.355596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:00.357087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6660109-29c8-40fd-b0c1-973fab386147 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:00.376503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 275/540] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:00.382688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:00.391612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab362db-3e04-4ac2-a9c8-776758b225b7 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.391905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab362db-3e04-4ac2-a9c8-776758b225b7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.392192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab362db-3e04-4ac2-a9c8-776758b225b7 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.393786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 276/541] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:00.399709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.399995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.400277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.432335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:00.434180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:00.516930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:00.530386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b2aae-b0ae-4e77-9118-23c16e1788ff None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:00.535019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 277/542] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:00.583485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:00.584155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.584441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.584721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.585558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=9cd68b65a3cb460e8d6dee6e7ea4f04c) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:00.585892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:00.587354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:00.600177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 266/543] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:00 2022] GET /identity/v3/role_assignments?user.id=9cd68b65a3cb460e8d6dee6e7ea4f04c&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:00.600855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:00.761473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a87d5-4ace-4a6d-9fef-ab8a34a11c20 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:00.799695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:00.800740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:00.801189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:00.801606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:00.812995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:00.820931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:00.822057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:00.823584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:00.826463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 278/544] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:00.833835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:00.961547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:00.988029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3ca8a-3957-4b91-966e-340c9830fcf9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.031218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.031903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.032191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.032470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.033225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:01.033534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:01.034991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca3573-6c72-4384-aff6-6a4ee97ecf0c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:01.048084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 267/545] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:01.053747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.060458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280176-5268-4731-8007-14107ca32d11 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.060755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280176-5268-4731-8007-14107ca32d11 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.061040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a280176-5268-4731-8007-14107ca32d11 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.062729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 268/546] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:01.067988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.068281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.068563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.102733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:01.103916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:01.130451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:01.180175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a90ad-a0b8-4451-87be-172c6f389041 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.223445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.224268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.224584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.224876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.248224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:01.248412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 269/547] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:04:01.249824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:01.271477 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:01.275613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:01.277078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:01.278379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:01.278379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:01.278379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:01.278379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:01.278379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 279/548] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:01.286345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.394249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:01.428905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245e829-2809-43e6-9023-e6f2af31b987 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.436889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:01.447751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea08bda-694d-404f-8c85-4a5e62c82b8f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.478530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.479223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.480036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.480319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.481058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:01.481388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:01.482786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:01.484061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.485050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.485569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.486017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.497076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:01.505137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:01.506089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:01.506922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:01.508116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 280/549] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:01.509718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 270/550] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:01.518866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.519045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.634038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decdb40-acfb-41f6-8912-7952ce269a78 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.703579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507897bd-12f9-43bf-99ed-8a39e3451d51 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.711065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.711883 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.712170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.712450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.726039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:01.728549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:01.731212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:01.759033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:01.760209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:01.762439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 281/551] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:01.764781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.765458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.765964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.766248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.767262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.768150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:01.768467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:01.769897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:01.790763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 271/552] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:01.796803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.810151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:01.886586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7b196-8511-475c-a43f-0e89ae5ef5e0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:01.922886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:01.923563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:01.923913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:01.924196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:01.925846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:01.925846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:01.926913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:01.945484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 282/553] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:01.967946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:01.984236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5a96a-134e-45a3-824b-416c7201b18e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.023380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.024432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.025529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.026127 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.055026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:02.056521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:02.094185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:02.095188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:02.096080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:02.096080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:02.096080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:02.096080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:02.106007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 272/554] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:02.108718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.122182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:02.147964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14385853-449a-4723-9b1b-46e34a001ba2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.171979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:02.194370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.195028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.195313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.195959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.311884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f6f65-cfba-4686-ac92-be0e5927b81b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.316490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:02.318003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:02.355832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.356666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.356960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.357565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.358894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:02.359216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:02.360769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53dc4-aa52-455b-854a-285c0e7bb615 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:02.380946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 273/555] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:02.382485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee2f8-86a5-4534-a82c-86b6da16e534 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.382877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee2f8-86a5-4534-a82c-86b6da16e534 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.383253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deee2f8-86a5-4534-a82c-86b6da16e534 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.384853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 274/556] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:02.392546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.392546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.392546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.409102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:02.410593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:02.424955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:02.451572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 283/557] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:02.452704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.503484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 275/558] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:02.503484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.539709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:02.586503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e887d967-258b-4436-a0d0-e56d93b4153b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.633071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.634180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.634468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.634759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.644105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff9c4b-5766-463b-a621-3e8e85f18aeb None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.644670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:02.646335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:02.668477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:02.672398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:02.673390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 284/559] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:02.675087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.692043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.693793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.694357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.694859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.710076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:02.711939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:02.732150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:02.733184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:02.734125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:02.734125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:02.734125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:02.734125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:02.734125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 276/560] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:02.734850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.736573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:02.795497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75527239-32f9-4639-86b4-fc5d68343e58 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.811899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:02.833489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78e06b-d435-4f47-b1b8-393c4be9dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.834322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e06b-d435-4f47-b1b8-393c4be9dd6f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.834611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e06b-d435-4f47-b1b8-393c4be9dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.834896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78e06b-d435-4f47-b1b8-393c4be9dd6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.846688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b1acb-88ef-454c-85e9-34bbb5ea661b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.846827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78e06b-d435-4f47-b1b8-393c4be9dd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-eb78e06b-d435-4f47-b1b8-393c4be9dd6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:02.855044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:02.856041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:02.857050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:02.860961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 285/561] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:02.862195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bb50f-0687-44d7-97b7-96bd0ca3dd10 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.862478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bb50f-0687-44d7-97b7-96bd0ca3dd10 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.862757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bb50f-0687-44d7-97b7-96bd0ca3dd10 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.864349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 286/562] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:02.865030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bb50f-0687-44d7-97b7-96bd0ca3dd10 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.890747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:02.891454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:02.891740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:02.892015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:02.892858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:02.893346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:02.894638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:02.918945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 277/563] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:02.918945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:02.987817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bb50f-0687-44d7-97b7-96bd0ca3dd10 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:02.990149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.021986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.022902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.023440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.024018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.024333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8960815-4210-4295-a3b9-83429204afaa None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.024771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:03.025028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.026465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f776b2-09ec-40bd-9baf-d1539c732046 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.038165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 287/564] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:03.039390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c47cd1-3f53-43f9-8d6e-126b7d141512 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.039716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c47cd1-3f53-43f9-8d6e-126b7d141512 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.040000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c47cd1-3f53-43f9-8d6e-126b7d141512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.056496 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c0c47cd1-3f53-43f9-8d6e-126b7d141512 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:03.058189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.058324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c0c47cd1-3f53-43f9-8d6e-126b7d141512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:03.063888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.064553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.064833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.065105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.065880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:03.066194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.067619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.075835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 278/565] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:03.076645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.141949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 288/566] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:03.141949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3884deb-e9cc-4d2a-a90a-988d52c9469d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.141949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3884deb-e9cc-4d2a-a90a-988d52c9469d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.141949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3884deb-e9cc-4d2a-a90a-988d52c9469d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.141949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 289/567] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:03.141949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3884deb-e9cc-4d2a-a90a-988d52c9469d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.183712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60606b8-fcd3-4cb3-852b-4fdd132baf25 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.253965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.254770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.255060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.255343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.267563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.269038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.282480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:03.287465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:03.288350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:03.289253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:03.289253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:03.289253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:03.289253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:03.289253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 279/568] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:03.289746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.290923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3884deb-e9cc-4d2a-a90a-988d52c9469d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.326659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.327445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.327724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.327994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.334811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.336254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.336534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-5b34a9b0-67c4-4b3d-926a-8b7046bac943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:03.350604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:03.351706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:03.352658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 290/569] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:03.353170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.353396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.353605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.371141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:03.372322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:03.394491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35d325-794b-487f-9d68-3319c1088b9e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.428613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.429407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.429782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.430087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.437585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 291/570] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:03.438459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.448845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.450724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:03.469880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:03.470973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:03.472036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:03.472036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:03.472036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:03.472036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:03.472036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 280/571] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:03.472036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.522080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.537481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef048e-d86a-41be-bd0c-ef63bcdd8049 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.568823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.572038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.572838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.573699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.574012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.575384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467fc3-9bde-4d68-8c3f-70f4774c4107 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.584128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:03.592047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:03.593157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:03.594178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 292/572] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:03.594876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.614766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.615432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.615719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.616002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.616731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:03.617044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.618464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.630916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 281/573] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:03.631717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.704317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5d61-7a39-4eee-8b84-4a69b2cb8525 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.730268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c438dc-90ed-4a8d-802d-3aac067549f1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.737689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.738366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.738647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.738920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.739691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:03.739995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.741415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.754357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 293/574] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:03.755147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.758404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.764640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.765435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.765725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.766034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.776968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:03.784252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:03.785344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 282/575] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:03.786431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.805033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:03.859769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857b5c-e394-4c8d-a0f5-4a2e9aeb7b17 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.887746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d77592-b869-4a4c-9e1b-fc4d73594fde None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:03.894347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.895011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.895298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.895980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.896709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:03.897023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.898439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.910531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 294/576] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:03.911326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.922727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:03.923396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:03.923677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:03.923951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:03.924696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:03.925001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:03.935385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 283/577] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:03.936168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:03.972920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.012067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea19501-2334-497e-a75a-996f00633601 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.015308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.037117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b427f51f-d39e-42a8-b51b-1d64b4ae982e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.045272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.046099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.046379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.046653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.053141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.054653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:04.069102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:04.070064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 295/578] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:04.071604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.079359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.080445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.080733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.081007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.081870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=5c26b297875b47bf8b14775b4fb63c9f) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:04.082185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.083627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.089949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 284/579] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:03 2022] GET /identity/v3/role_assignments?user.id=5c26b297875b47bf8b14775b4fb63c9f&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:04.090722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.185021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fa124-1b4a-4667-818a-452a8fda1f34 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.211241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.215343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92b8a-a50b-4f5c-95c2-006dcde948b8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.223025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.223624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.223903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.224173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.224929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:04.225232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.226659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.235586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 296/580] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:04.236435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.280983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.281924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.282217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.282504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.290766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.292839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:04.307671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:04.308960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 285/581] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:04.315218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.318048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.358059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c67a9-e4f2-437a-9a36-01472e0a5e40 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.393130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.393960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.394249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.394529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.405832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.407293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.423060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d23b9-40de-4805-a42c-7e88adda37d4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:04.424919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:04.425902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:04.426865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:04.426865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:04.426865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:04.426865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:04.426865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 297/582] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:04.427161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.464840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.465510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.465820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.466111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.466902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:04.467215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.468447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.469573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.482725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 286/583] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:04.482993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.543469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e1538-37c5-4fc8-9bc3-d066a33f342f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.550963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.581469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.582582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.583018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.583450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.594270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.595735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.596688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae16b3-3899-4ab4-9ddb-2ae5386557c9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:04.613570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:04.614551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:04.615470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:04.615470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:04.615470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:04.615470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:04.615470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 298/584] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:04.615758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.638521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.639201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.639545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.639828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.640720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:04.641039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.642590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.662262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 287/585] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:04.662979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.718121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.727354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5144b-60e5-4deb-933a-0d5b52b46013 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.762810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.763396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.763679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.764047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.764678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:04.764989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.766426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.772761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e434552-0d1a-4604-9041-9a9b72f4b026 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.780718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 299/586] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:04.781364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.800731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:04.815628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.816569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.816905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.817198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/75c9161930b64f0e910a4a3323fa733a/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.832472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=75c9161930b64f0e910a4a3323fa733a, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.833989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.884081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b281963-f528-470d-8062-2273fb31d40d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:04.905837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 288/587] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:04 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/75c9161930b64f0e910a4a3323fa733a/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:04.905837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.937911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:04.938772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:04.939472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:04.939763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:04.940805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:04.941122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:04.943502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:04.959439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 300/588] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:04.961116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:04.978984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.020570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6c3a5-6eaf-40c8-ba0e-22ecf6765ffd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.059634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.060625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.060985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.061339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.082287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.083135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:05.105610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:05.106740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:05.108061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:05.108061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:05.108061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:05.108061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:05.108290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeff4d-8752-4b3f-a33e-f2d8c5d27076 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.108365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 289/589] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:05.108365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.142515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.155231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.156040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.156324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.156597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.168787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.171006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:05.190817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:05.193715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:04:05.194741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:05.198593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 301/590] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:05.199916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.241161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e92aa-5110-49c2-8fa6-0624b3acdc68 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.278836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.280319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.280829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.281310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.289066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.290803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.290930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:05.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:05.308301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:04:05.309252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:05.311873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 290/591] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:05.317160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.327573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7786e68-2b33-4a97-a2f8-f2a10b7e7986 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.374178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.374849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.375132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.375411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.376131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:05.376443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.378576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.393431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 302/592] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:05.394571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.417296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.440785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca135d-6a93-4125-aa14-eb7398388539 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.491406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.492088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.492375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.492653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.493759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:05.494115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.496465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.512407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881bea2-06ea-4957-bf77-aa4bca4c5303 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.521942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 291/593] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:05.523098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.552740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.561650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.564710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.564710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.564710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.564710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:05.564710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.566481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.590111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 303/594] 10.222.0.64 () {56 vars in 1139 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:05.590884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.650274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffe087-d2e1-4b68-974e-34ea97857161 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.695172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.695993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.696558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.696841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.706785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.707893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae0f75-c783-449c-8eee-605f81f2d579 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.708250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.711913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:05.726674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:05.727637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:05.728568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:05.732682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 292/595] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:05.741180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.756310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.757120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.757406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.757682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.771563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.773199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:05.796435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:05.797379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:05.798342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:05.798342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:05.798342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:05.798342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:05.801881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 304/596] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:05.802960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.855802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073de17a-e290-45db-bc9f-9fcb2f30d64f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.858093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:05.902295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.903430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.904004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.904743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.917124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.919015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.933594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c868475-95c6-4bf9-8daa-18f8039ee833 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:05.938908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:05.939809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:05.940722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:05.940722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:05.940722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:05.940722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:05.947480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 293/597] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:05.949235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:05.970879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:05.972038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:05.972695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:05.973172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:05.974386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:05.974909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:05.976656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:05.995937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 305/598] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:05.997244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.015679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.069620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd13bd-1de7-48c6-8dad-d05321391abd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.105510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.106171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.106454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.106730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.107459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:06.107767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.109146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.109577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.113177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990f59f-399a-4949-b9e4-544f12c0b286 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.126249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 294/599] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:06.127097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.151237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.152213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.152610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.152989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.153956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:06.154272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.156015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.170634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 306/600] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:06.171472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.241740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddf058-7328-4ed6-9cd5-d96c7229c1d4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.255449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.277558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.278461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.278745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.279021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/4761c5c956f84b15a76074531901c462/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.282984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e740dc-de0f-444f-8c04-5e41dec4a391 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.294868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=4761c5c956f84b15a76074531901c462, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.296562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.317708 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.318525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.318802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.319072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.326442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.327809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-a66dfd56-d637-49a2-aa9e-abf126988c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:06.341563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:06.342705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:06.343644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 307/601] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:06.344366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f66fd-b03f-40ab-9372-b078eee22a49 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.344517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f66fd-b03f-40ab-9372-b078eee22a49 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.344788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f66fd-b03f-40ab-9372-b078eee22a49 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.346206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 308/602] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:06.347371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f66fd-b03f-40ab-9372-b078eee22a49 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.369498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.397834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 295/603] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:06 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/4761c5c956f84b15a76074531901c462/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:06.397834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.475834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f66fd-b03f-40ab-9372-b078eee22a49 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.525893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1b3c5-00f0-4464-8813-46498bb5b88e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.528136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.530333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.530615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.530889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.544806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.546977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-def51f97-e984-430f-8123-d1d985ed328a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:06.563500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:06.564646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:06.565732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:06.569839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 309/604] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:06.569839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.569839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.569839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.578291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.578897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.579182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.579458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.580243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:06.580552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.582017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.595724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 296/605] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:06.596448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:06.596577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.597762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:06.623424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.673141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 310/606] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:06.674029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.686883 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.732727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5673f-094f-45a7-8c05-e35497268b16 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.770628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.771295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.771679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.771960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.772851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:06.773165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.774726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.782755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1f0b-b3cb-428d-a66d-000193319770 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.789205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 297/607] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:06.790146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:06.819715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.821176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.821509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.821788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/a20f362695fa4fbdb685632d4369bf04/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.844546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=a20f362695fa4fbdb685632d4369bf04, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:06.846240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:06.885001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:06.904617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34368d57-3439-4758-bbc7-d8a5c5ee3355 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:06.937953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:06.938741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:06.939024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:06.939297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:06.949966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:06.957730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:06.958883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 298/608] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:06.959848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.062664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6341-4bd2-40d7-9f95-35895c040749 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:07.098891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a83d2-c387-4707-9d3c-9747e17bd89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:07.099707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a83d2-c387-4707-9d3c-9747e17bd89a None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.099998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a83d2-c387-4707-9d3c-9747e17bd89a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.100319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a83d2-c387-4707-9d3c-9747e17bd89a None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/9cd68b65a3cb460e8d6dee6e7ea4f04c/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.114716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a83d2-c387-4707-9d3c-9747e17bd89a None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=9cd68b65a3cb460e8d6dee6e7ea4f04c, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:07.116183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a83d2-c387-4707-9d3c-9747e17bd89a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:07.263646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 311/609] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:06 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/a20f362695fa4fbdb685632d4369bf04/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:07.264491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.269661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:07.288415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 299/610] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:06 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/9cd68b65a3cb460e8d6dee6e7ea4f04c/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:07.289612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8b40-09a2-406c-a50e-138b87a5c557 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.289937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8b40-09a2-406c-a50e-138b87a5c557 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.290221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a8b40-09a2-406c-a50e-138b87a5c557 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.291889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 300/611] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:07.297188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.297472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.297762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.339246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:07.359278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:07.359278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:07.414191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03da316-6c73-4110-9884-c3a9874c0b90 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:07.494323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:07.495267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.495557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.495835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.496611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:07.496922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:07.498381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:07.508313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 312/612] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:07.509834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 301/613] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:07.515274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.539543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.653754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eee695-f17c-47c9-bbf2-2a96177e2a1f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:07.671375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8908a3-e1b2-4102-9a4b-2e108cf8b7d3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:07.680433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:07.692662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:07.697954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.697954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.697954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.703513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:07.705105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:07.706607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:07.718314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:07.719182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.719471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.719752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:07.725332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:07.726878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:07.727775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:07.727775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:07.727775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:07.727775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:07.727775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 313/614] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:07.731881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:07.732780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:07.741275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:07.743441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:07.746554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 302/615] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:07.753830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.882693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e9b81-2f11-4e6b-99ff-37f48de7529f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:07.916041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1cb0d-1ed7-44f8-9ac0-f5311f8053ea None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:07.923290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:07.924466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.924776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.925120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.926014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:07.926798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:07.928983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:07.946227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 303/616] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:07.947471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:07.986552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:07.987237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:07.987530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:07.987806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:07.988542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:07.988849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:07.990292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.000683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:08.015992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 314/617] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:08.021517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.064470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832376c6-6c57-4321-b1d3-e8180ac3d0f7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.114685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.115581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.115885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.116173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.128430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.130255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.148922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:08.150806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:08.152870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:08.155239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:08.155239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:08.155239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:08.155239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:08.155239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 304/618] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:08.159486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.270832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b889e-55d3-45a8-a7b0-e6c18de11800 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.274270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:08.309222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.309937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.310229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.310229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.310229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:08.314166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.314166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.326344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 305/619] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:08.331826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.352676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75b33-3828-49aa-ab63-b4591035771f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.402713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.403959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.404808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.406191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.420638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.423128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:08.448320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:08.449348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:08.450354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:08.459523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 315/620] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:08.462813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.502624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8224a-5ac6-4b7f-a1e8-128981379ae4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.567319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.568505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.568991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.569533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.582282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.585242 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:08.611844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:08.612853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:08.613853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:08.620736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 306/621] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:08.625875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.643421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:08.648182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bca844-5543-419d-90fd-f58f30f3f720 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.660992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:08.707331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.708346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.709268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.709558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.710783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:08.711098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.713335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88898-758e-4bb6-ae07-5af828cee77a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.739210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 316/622] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:08.740688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a834a-f5cd-4e8e-9694-efe7ddc24ffa None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.740984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a834a-f5cd-4e8e-9694-efe7ddc24ffa None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.741261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a834a-f5cd-4e8e-9694-efe7ddc24ffa None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.743239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 317/623] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:08.743957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a834a-f5cd-4e8e-9694-efe7ddc24ffa None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.782520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fddf47-1f66-4ae5-af79-d4ba48609f81 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.821866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.822569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.822891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.823225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.824174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:08.824494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.826160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c2c0c-995a-43a3-860e-5de1cdb1f6e4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.849521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 307/624] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:08.850982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.851281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.851568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.868659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:08.869986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:08.883547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a834a-f5cd-4e8e-9694-efe7ddc24ffa None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:08.926797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:08.927920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:08.928205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:08.928554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:08.940970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:08.942545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:08.957065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 308/625] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:08.958018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.960998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:08.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:08.972190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:08.974378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:08.974378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:08.974378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:08.974378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:08.978670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 318/626] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:08.984488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:08.992268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.082311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8162da8-76b1-489e-99a9-ac1b452d3352 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.108182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd5211-fbcf-4498-846b-00725121ae94 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.122744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.123406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.123687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.123964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.145845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.146795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.147263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.147744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.148661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:09.149163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.150760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.166429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 319/627] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:09.168163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.200956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.202462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.205727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.234606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.274829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfbb07-5dac-461f-a871-805f4bbdfd0a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.312974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.314182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.314675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.315134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.321197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 309/628] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:09.321197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.331549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:09.340492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:09.341437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:09.342447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:09.349474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 320/629] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:09.350602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.429812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0c68b-a085-45f2-8649-bfa97eb13807 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.432795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.458731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a8900-45bb-41a8-8b76-c4a0c8c5f1c4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.471307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.472102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.472398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.472663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.480355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.482168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.485924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.497577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.505905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.505905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:09.506113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:09.507123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:09.508193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:09.508639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.508709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 310/630] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:09.508709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.511234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.512701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:09.532977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:09.534158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:09.535166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:09.535166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:09.535166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:09.535166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:09.535166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 321/631] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:09.535166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.618796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf3333-b9a6-4a89-bf0e-9e6973f43f3f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.647287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54966a6a-03fd-44ac-ba48-26cf81712e6c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.657125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.658075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.658501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.658932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.659820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:09.660271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.661822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.671965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 311/632] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:09.673031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.690406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.691078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.691366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.691647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.692495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:09.692747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.694230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.708235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.709518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 322/633] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:09.710539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.749373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.785304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182592a-7c59-4c30-86bb-4866643cf843 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.815633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a362-1f43-4adf-be20-7b9b90e36a71 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.818526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.819190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.819475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.819755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.820478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:09.820793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.822204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e563bd-5d23-4761-8325-9fec4f24ba81 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.834707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 312/634] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:09.835980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69949e-461d-492d-b632-d5088cac1fa8 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.836272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69949e-461d-492d-b632-d5088cac1fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.836547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69949e-461d-492d-b632-d5088cac1fa8 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.837780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 313/635] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:09.839137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69949e-461d-492d-b632-d5088cac1fa8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.856113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.856910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.857199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.857480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.867744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.869264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-fef35470-e66b-481a-8058-99928f18af66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:09.888258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:09.889371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:09.890479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:09.890479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:09.890479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:09.890479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:09.890479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 323/636] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:09.890768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256877-d61d-47cf-bfe9-8f348e418d50 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.890928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256877-d61d-47cf-bfe9-8f348e418d50 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.891199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256877-d61d-47cf-bfe9-8f348e418d50 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.892612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 324/637] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:09.894874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45256877-d61d-47cf-bfe9-8f348e418d50 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:09.925586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.941473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69949e-461d-492d-b632-d5088cac1fa8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:09.976366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:09.977256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:09.977539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:09.977850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/5c26b297875b47bf8b14775b4fb63c9f/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:09.985995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:09.992340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=5c26b297875b47bf8b14775b4fb63c9f, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:09.993828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:09.998282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45256877-d61d-47cf-bfe9-8f348e418d50 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.031614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.032394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.032676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.032952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.039359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.040797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-8d59c900-c368-48ab-b9e4-a1f1035e1c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:10.054763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:10.055903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:10.056846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 325/638] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:10.057346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0e835-5999-4bb6-abf3-7036f06a8b03 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.057488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0e835-5999-4bb6-abf3-7036f06a8b03 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.057881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0e835-5999-4bb6-abf3-7036f06a8b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.070045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 314/639] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:09 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/5c26b297875b47bf8b14775b4fb63c9f/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:10.070512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.074902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6ff0e835-5999-4bb6-abf3-7036f06a8b03 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:10.076133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6ff0e835-5999-4bb6-abf3-7036f06a8b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:10.161019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 326/640] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:10.162432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.162729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.163074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.192243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:10.193472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:10.201466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937440-652a-4204-9267-a6d9f8ebbdc8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.245940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.247053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.247347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.247779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.248646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:10.248958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.251128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.255054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:10.269833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 315/641] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:10.269833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.272077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 327/642] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:10.273009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.292949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:10.378375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b18a6-e636-409d-a1f4-c62bbd58f39c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.392976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914d6b3-9e91-4d8e-9e97-6b153ebaea4e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.414869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.415455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.415741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.416014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.417424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:10.418012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.419465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.430691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.431142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 316/643] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:10.431940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.432074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.432689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.433118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.446389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:10.454782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:10.455850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:10.456747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 328/644] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:10.457489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.503262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:10.528685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:10.550396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93966040-c55a-4fc9-b056-edc6af5797f2 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.568392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352f41-a5f8-4f54-9f02-c731869d7ad3 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.587466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.588269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.588956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.588956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.596712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.598215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.604885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.605941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.606224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.606499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:10.612698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:10.613658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 317/645] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:10.614832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.623022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:10.630815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:10.631969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 329/646] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:10.632840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.734559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedf7cc-cdbf-4fe2-a384-4d150299716c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.746135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e1d88-9281-400c-a360-b94c520a5db2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.751623 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:10.771563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.772459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.772911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.773190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.774120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=75c9161930b64f0e910a4a3323fa733a) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:10.774435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.774702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:10.776546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.782844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 318/647] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/role_assignments?user.id=75c9161930b64f0e910a4a3323fa733a&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:10.783640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.791981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.793064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.793562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.794205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.795239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:10.795703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.797156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.812305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 330/648] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:10.812305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.918820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e43d7-7f0c-48d0-82f9-14c394ce4857 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.948905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d6573-ea3c-4dcb-b8ae-172d6f6fe7af None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:10.961233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.961946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.962237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.962521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.963901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:10.964276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.965767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:10.987171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 319/649] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:10.987933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:10.990707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:10.991787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:10.992259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:10.992718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:10.993669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:10.994183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:10.996608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.005608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 331/650] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:11.006286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.043241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.076674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.127327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef02-c6f0-4699-822a-baf356303201 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.133773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddb314-3be1-4a1a-8818-e55d3b20f3a7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.176395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.177356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.177748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.179894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.181550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.182643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.182933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.183219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.194643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.199695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:11.216901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:11.218519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:11.219559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:11.219559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:11.219559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:11.219559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:11.219559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 320/651] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:11.220824 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.271479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.273076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.327792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.329582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.339890 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14533e4b-8bad-4e18-b4d3-12472e9b5dc6 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.376773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.377954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.378327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 332/652] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:11.378621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.379132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.379238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.390518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.392399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:11.411681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:11.412629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:11.414137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:11.414137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:11.414137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:11.414137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:11.414137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 321/653] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:11.414137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.485155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89187-eba8-4fcf-ab70-08f4ca26d10a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.519762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3594874-e5f2-48bf-a27b-2cb5c070de0e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.521173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.522159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.522816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.523295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.524223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:11.524753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.527008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.539702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 333/654] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:11.541301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.556351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.557784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.558028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.558219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.558366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.569127 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.570707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.572515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:11.590176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:11.591177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:11.592726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:11.592726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:11.592726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:11.592726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:11.592726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 322/655] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:11.592726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.653163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6a98e-1038-4ef8-98de-4ab1122c0618 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.689081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.690146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.690643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.691128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.692061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:11.692600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.694326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.699301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102a83e-b45e-4d86-854b-435d5adfe5af None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.708768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 334/656] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:11.709983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.736391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.737411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.737527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.737740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.745278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.746825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:11.761897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:11.762930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 323/657] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:11.764491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.790172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.820831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74097-1afb-4e3b-9eb6-4975b2ed3127 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.832713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:11.859988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.860636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.861006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.861354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.863384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:11.863812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.865240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.878508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 335/658] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:11.879495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.888547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92245fc7-4ef6-4154-a7af-decfacc16076 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:11.932641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:11.934039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:11.934741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:11.935229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:11.950200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:11.951950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:11.973746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:11.974862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 12:04:11.975814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:11.977822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 324/659] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:11.979109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:11.996180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a613f-a953-4816-af5d-3ec4f838547e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.029542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.034916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.035840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.036267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.040508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.040508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:12.040508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.040508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.063539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 336/660] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:12.063539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.131270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f636-d273-4274-b57b-4bed69a305e8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.149102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.172121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.173035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e96d08-cd92-443d-82f1-08006e16709c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.173527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.174060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.174640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.183303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.184785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:12.199098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:12.200015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:12.200947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 325/661] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:12.202286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.218986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.219773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.220065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.220344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.221182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:12.221494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.222983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bea1f-5831-419d-8652-d07374c94c32 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.243179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 337/662] 10.222.0.64 () {56 vars in 1139 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:12.244979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81450009-e778-41cf-be3c-b91c379b0998 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.245440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81450009-e778-41cf-be3c-b91c379b0998 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.245936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81450009-e778-41cf-be3c-b91c379b0998 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.247497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 338/663] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:12.248391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81450009-e778-41cf-be3c-b91c379b0998 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.301094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.314931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33bb9-7fc7-4348-96d9-402f3e461fd7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.349333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354c821-0125-488a-a75b-592a7cc3c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.350018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354c821-0125-488a-a75b-592a7cc3c164 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.350307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354c821-0125-488a-a75b-592a7cc3c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.350588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354c821-0125-488a-a75b-592a7cc3c164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.357701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81450009-e778-41cf-be3c-b91c379b0998 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.393772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.395794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.396723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.397214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.397673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.398672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:12.399210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.401415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.414344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 339/664] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:12.415473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.420638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354c821-0125-488a-a75b-592a7cc3c164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.422233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354c821-0125-488a-a75b-592a7cc3c164 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.527764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 326/665] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:12.533597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.533919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.534202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.534428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66cdf-844f-4eba-b29c-57129d8bde08 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.545124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.551706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:12.552913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:12.573512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.574464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.574750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.575027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.628799 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 327/666] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:12.629838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.634969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.652974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.655048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.737508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f0927-caf5-4476-8ea0-76736a0a22d8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.763887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 340/667] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:12.763887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.772364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.778390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.779115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.779704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.780042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.780883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=4761c5c956f84b15a76074531901c462) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:12.781266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.782744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.788958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 328/668] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/role_assignments?user.id=4761c5c956f84b15a76074531901c462&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:12.789676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:12.874781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:12.909310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d47e-8a27-439f-9e10-0579a95976db None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.911928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0035949c-dbb6-4921-9445-2462d790efdc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:12.955640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.956304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.956592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.956872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.964890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:12.966880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:12.967173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:12.967455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:12.969370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:12.979124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:12.980397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:12.981250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:12.981924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:12.981998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 329/669] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:12.982078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:12.982156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:13.002898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:13.003858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:13.004754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:13.004754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:13.004754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:13.004754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:13.008750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 341/670] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:13.009584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.074787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.102219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db91ce5-1776-4ae6-a768-4683e98cfc5e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.120866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d901c1-03b5-44ef-a9af-85c3a8643aa4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.131107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.140301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.141104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.141392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.141675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.153189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.154987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.160599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.161283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.161622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.161940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.163131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:13.163446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.165563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d11588-9a4e-4577-82cf-0ee6f995b653 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:13.173769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:13.174727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:13.175673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:13.175673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:13.175673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:13.175673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:13.176566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 330/671] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:13.177298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.189983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 342/672] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:13.189983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bab88-30cf-43d1-863d-9024f97ad487 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.189983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bab88-30cf-43d1-863d-9024f97ad487 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.189983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bab88-30cf-43d1-863d-9024f97ad487 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.189983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 343/673] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:13.189983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bab88-30cf-43d1-863d-9024f97ad487 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.300465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94ebea-989a-4f08-bb1b-9d80829fc96f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.320776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bab88-30cf-43d1-863d-9024f97ad487 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.341641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.342687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.342810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.343021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.343754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:13.344070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.345251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.346611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.357518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.358218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.372998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.372998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.372998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:13.372998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.373386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 331/674] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:13.373386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.373557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65163c-6d47-4bc3-9fe7-c194e9e5bd6a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.377095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 344/675] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:13.378466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.378757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.379030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.397528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:13.398678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:13.413137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.474740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 345/676] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:13.475533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb75e8-b1dc-4091-b6e0-6268290442a2 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.476061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.523064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.523891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.524173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.524446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.534875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.536345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:13.557688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:13.558900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:13.560023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:13.560023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:13.560023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:13.560023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:13.561627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 332/677] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:13.562626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.592707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3069254-7d9a-423c-8122-d3b266c3cb52 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.608015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.630935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.631885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.632174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.632457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.639581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.642485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:13.657257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:13.658217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:13.659129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:13.663269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 346/678] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:13.663914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.664180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.673517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e40705-44fa-4948-b4dc-11319f0e2ae9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.708184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.708982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.709272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.709551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.718077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.719543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:13.733145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:13.734142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:13.735102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 333/679] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:13.735602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.776223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fddcb-aafd-4a3d-bbc1-d34548ebd30c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.810908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.811894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.812008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.812253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.822523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:13.830888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:13.831833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:13.832693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 347/680] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:13.833400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.849565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adeecc-b037-4c70-86f3-efebfdad01b0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.866450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.886995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.887663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.887953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.888233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.888959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:13.889264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.890681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:13.903636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 334/681] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:13.905065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:13.920394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:13.944780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0d2c-f4b4-4d5d-b193-2a2ae94ca8d2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:13.982214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:13.982879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:13.983169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:13.983449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:13.984240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:13.984548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:13.986013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.000116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 348/682] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.000943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.027034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c057f0-c8b3-477f-96f9-8d35716fbd0c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.070192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.071488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.071895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.072257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.073042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:14.073462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.074942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.089840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 335/683] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.090509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.110345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.120154 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b2986-7b04-4a54-82e0-00a0e977d7fe None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.157683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.158388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.158675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.158956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.159702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:14.160013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.161386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.167321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.174902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 349/684] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.174902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.203121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49827244-670b-41fe-8c5e-3c0cc3794ede None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.240863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.241658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.241994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.242277 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.251010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.252479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:14.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:14.268411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:14.269578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 336/685] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:14.270690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.286692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1b9e0-b937-4081-bf16-1442c34528f0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.322933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.323790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.324137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.324483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.325388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=a20f362695fa4fbdb685632d4369bf04) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:14.325765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.327293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.333320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 350/686] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/role_assignments?user.id=a20f362695fa4fbdb685632d4369bf04&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.334190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.356690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.405345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70586-fb48-4d43-9cea-2374645b34b9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.449132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.459011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.459795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.460134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.460655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.464226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=9cd68b65a3cb460e8d6dee6e7ea4f04c) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:14.465073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.466790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed770ec-dc08-4b59-8de7-a988ecad677e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.466992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.477046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 337/687] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/role_assignments?user.id=9cd68b65a3cb460e8d6dee6e7ea4f04c&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.478311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.543097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.544377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.544861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.545354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.559211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.561128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:14.581769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:14.582825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:14.583758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:14.583758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:14.583758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:14.583758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:14.586395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 351/688] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:14.593244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.608800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e110ca1-09b7-417f-a854-a543f3926abf None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.646550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.647487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.647627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.647850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.648775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:14.649099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.650627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.671616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 338/689] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.677858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.681292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.735255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837194e-ac44-44e7-a171-b73f3100dc98 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.744234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.777944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.778703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.779146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.779684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.780421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:14.780737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.782177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.795141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 352/690] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:14.801951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:14.809856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98bf5e-5db8-49c1-92b5-999ddfe219ff None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.854977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea406a-b23f-4d9f-b07e-9a8d43db4acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.856025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea406a-b23f-4d9f-b07e-9a8d43db4acc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.856519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea406a-b23f-4d9f-b07e-9a8d43db4acc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.857441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea406a-b23f-4d9f-b07e-9a8d43db4acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:14.944710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb098d8-ff20-4e37-bf5f-0d4755da4a97 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:14.966599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea406a-b23f-4d9f-b07e-9a8d43db4acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:14.968467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea406a-b23f-4d9f-b07e-9a8d43db4acc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:14.983824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:14.995171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:14.995171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:14.995171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:14.995171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.003680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.005655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-4d8bb990-7875-4ee0-aee5-b2361e546458 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:15.026357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:15.027616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:15.028681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 353/691] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:15.029927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84539-53d8-4e1b-aa39-042210a802b1 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.029927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84539-53d8-4e1b-aa39-042210a802b1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.030176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce84539-53d8-4e1b-aa39-042210a802b1 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.035532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 354/692] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:15.035532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce84539-53d8-4e1b-aa39-042210a802b1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.039076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.094781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 339/693] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 12:04:15.096115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.096403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.096682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.114273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:15.115480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:15.185627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce84539-53d8-4e1b-aa39-042210a802b1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.188461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 340/694] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:15.189362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.240157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.240841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.241123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.241397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.244052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:15.244987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.246552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.269904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 355/695] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:15.270897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.302100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.318603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899124-367b-4eab-b317-ddaabc18df1e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.327454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.355219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.356162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.356516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.356889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.367945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.370349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.386152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7209c-dd4c-42e2-9710-97a88d1c7421 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:15.388504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:15.389583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:15.390762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:15.390762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:15.390762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:15.390762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:15.395947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 341/696] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:15.396869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.427883 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.429278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.429710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.430161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.431026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.433578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:15.449406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:15.450669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:15.451646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:15.458899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 356/697] 10.222.0.64 () {56 vars in 1129 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:15.459985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.499861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96abd3-afb0-4a58-887e-74a47df42c11 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.536107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.536763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.537139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.537357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.540877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.576214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560de13-5839-42b6-a49e-ea64e4043424 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.591649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.609134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.610594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.615363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.616840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.617289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.617711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.618721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:15.619203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.621089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.636609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 357/698] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:15.637896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.718759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 342/699] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 12:04:15.719729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.757304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a810e-f805-498f-af81-cf71b566c609 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.769070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.804926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.805934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.806217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.806491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.808314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:15.808627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.810028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.819387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 358/700] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:15.819387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.856000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:15.860402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5601c-0383-434c-8b9d-298f45536fba None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.896758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b390-7798-45d1-9337-674c96060372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.897794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b390-7798-45d1-9337-674c96060372 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.898234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b390-7798-45d1-9337-674c96060372 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.898654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b390-7798-45d1-9337-674c96060372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.906305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628b390-7798-45d1-9337-674c96060372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.908518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628b390-7798-45d1-9337-674c96060372 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-0628b390-7798-45d1-9337-674c96060372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:15.925019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:15.926176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:15.927323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:15.928536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757792bc-2e0a-4f1e-8489-3de815de808b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:15.930110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 343/701] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:15.931314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b390-7798-45d1-9337-674c96060372 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:15.968045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:15.969016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:15.969402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:15.969777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:15.981783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:15.983386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:16.002266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:16.003298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:16.004204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:16.004204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:16.004204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:16.004204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:16.008890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 359/702] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:16.009874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:16.045929 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:16.052717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b390-7798-45d1-9337-674c96060372 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.091729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:16.092792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.093283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.093738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.094745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:16.095256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:16.096916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.109955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 344/703] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jun 20 12:04:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:16.110607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:16.112526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:16.125831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545d833-4c53-423e-8c26-ec42ffbe10cc None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.161507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:16.162226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.162523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.162779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.163559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:16.163869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:16.165629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.179902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 360/704] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:16.186574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:16.328603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d2edb-4754-40b7-a7d5-4b800bc54d73 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.367282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad575e0d-3760-49e8-9032-aa75cbf03240 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.375144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:16.376117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.376602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.377080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.378018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:16.378556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:16.380131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.393534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 345/705] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:16.400966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:16.412882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:16.413532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.413837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.414120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.415059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=5c26b297875b47bf8b14775b4fb63c9f) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:16.415372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:16.418157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.430006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 361/706] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:16 2022] GET /identity/v3/role_assignments?user.id=5c26b297875b47bf8b14775b4fb63c9f&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:16.450215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:16.550827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf129c2-86bf-4520-b408-4e53955579d4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.599325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:16.600384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.600665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.600940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.613713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:16.615239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-db914614-4107-4144-a17f-d8f7f89c6933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:16.631129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:16.632121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:16.633051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:16.634906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 346/707] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:16.641215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:16.661178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:16.760731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabef424-25bd-48ee-ba1f-0b2ce79dcfc6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.797788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:16.798849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.799400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.799873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.800851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:16.801374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:16.803079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:16.817467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 362/708] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:16.822598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237994c1-38f6-4ea8-8784-d102627bad20 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.822913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237994c1-38f6-4ea8-8784-d102627bad20 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.822913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237994c1-38f6-4ea8-8784-d102627bad20 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.824070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:16.824490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 347/709] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:16.829837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca874d-7c5c-418a-bb01-e9a4302474a0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.830182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca874d-7c5c-418a-bb01-e9a4302474a0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.830757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca874d-7c5c-418a-bb01-e9a4302474a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.851077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f2ca874d-7c5c-418a-bb01-e9a4302474a0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:16.852331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f2ca874d-7c5c-418a-bb01-e9a4302474a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:16.914442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:16.948656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 348/710] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:04:16.950103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac27d-c15c-48d2-9e1c-5997124cb5fe None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.950397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac27d-c15c-48d2-9e1c-5997124cb5fe None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.950682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac27d-c15c-48d2-9e1c-5997124cb5fe None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.953003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 349/711] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:16.955998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14685a-d5a6-4ccf-877a-3343ea8dbd06 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:16.957624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:16.957942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:16.959071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:16.985669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:16.986921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:16.992604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:17.024907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:17.026042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:17.026640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:17.026846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:17.027862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=75c9161930b64f0e910a4a3323fa733a) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:17.028468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:17.032101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:17.044252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 363/712] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:16 2022] GET /identity/v3/role_assignments?user.id=75c9161930b64f0e910a4a3323fa733a&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:17.044993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:17.144429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 350/713] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:17.228286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:17.251084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed597cf-9e2c-47c5-8c1d-eb300f0f540e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:17.329128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:17.329981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:17.332041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:17.332041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:17.332041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:17.332631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:17.356892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:17.375455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:17.376824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:17.377785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 364/714] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:17 2022] GET /identity/v3/services/network => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:17.385469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:17.524002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc2f4-b8c9-497a-b23d-bb2e6a9b8a1b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:17.604650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:17.605524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:17.606525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:17.607859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:17.626186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:17.628764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:17.630288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:17.633138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a516e-acb8-4761-89a2-b29281cd42a2 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:17.666128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:17.667568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:17.668485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:17.668485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:17.668485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:17.668485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:17.668485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 351/715] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:17.674201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:17.680255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:17.680255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:17.681001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:17.681001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:17.681383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] RBAC: Adding query filter params (name=network) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:17.681698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:17.683840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:17.695814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 365/716] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:17.701974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:17.798820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bee00-883e-4bbd-80b2-08a39af3b7a6 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:17.845835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:17.847023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:17.847486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:17.848151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:17.849863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:17.850327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:17.852115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:17.865533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:17.874468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 352/717] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:17.881482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:17.931931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d9c74-e141-4035-a017-5e09f8d2a425 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:17.978187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:18.006062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:18.006732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:18.007014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:18.007286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:18.007992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] RBAC: Adding query filter params (type=network) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:18.008297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:18.014426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bceb8-4bbc-4eed-b4a6-36879fc8927f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:18.032449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 366/718] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:18.045109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b864004-c7a9-4ab6-b654-8344d06f1678 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:18.084459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cb61b-d54d-4b8b-91dc-9a352b6cee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:18.085142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cb61b-d54d-4b8b-91dc-9a352b6cee08 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:18.085424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cb61b-d54d-4b8b-91dc-9a352b6cee08 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:18.085696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cb61b-d54d-4b8b-91dc-9a352b6cee08 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:18.086463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cb61b-d54d-4b8b-91dc-9a352b6cee08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:18.088359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cb61b-d54d-4b8b-91dc-9a352b6cee08 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:18.166820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 353/719] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:04:17 2022] POST /identity/v3/users => generated 254 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:18.834130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe0bd3-bc79-4763-9e0d-e5b89bb5abcf None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:18.835267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe0bd3-bc79-4763-9e0d-e5b89bb5abcf None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:18.835767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe0bd3-bc79-4763-9e0d-e5b89bb5abcf None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:18.837654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 367/720] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:18.843391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822115c5-ed26-4dbd-81ab-62f4f8f0ed57 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:18.844289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822115c5-ed26-4dbd-81ab-62f4f8f0ed57 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:18.844779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822115c5-ed26-4dbd-81ab-62f4f8f0ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:18.870960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-822115c5-ed26-4dbd-81ab-62f4f8f0ed57 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:18.872554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-822115c5-ed26-4dbd-81ab-62f4f8f0ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:18.964962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 354/721] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:19.011406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe0bd3-bc79-4763-9e0d-e5b89bb5abcf None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:19.162594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe0bd3-bc79-4763-9e0d-e5b89bb5abcf None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:19.216504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:19.228864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:19.229687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.230003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.230288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.231029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:19.232431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:19.281459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ea224-6eb1-4113-a23b-6be361795e97 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.281824 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ea224-6eb1-4113-a23b-6be361795e97 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.282129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ea224-6eb1-4113-a23b-6be361795e97 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.283834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 355/722] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:19.288684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaf52b-e884-4e38-9e71-6ef15530a431 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.288983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaf52b-e884-4e38-9e71-6ef15530a431 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.289272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaf52b-e884-4e38-9e71-6ef15530a431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.308976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b0eaf52b-e884-4e38-9e71-6ef15530a431 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:19.310265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b0eaf52b-e884-4e38-9e71-6ef15530a431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:19.328474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 368/723] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:19 2022] POST /identity/v3/services => generated 251 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:19.350275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:19.412892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 356/724] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:04:19.455751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:19.507606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64138-e683-464f-bc2f-25e4c4815ac3 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.507953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64138-e683-464f-bc2f-25e4c4815ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.508182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d64138-e683-464f-bc2f-25e4c4815ac3 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.509592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 357/725] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:19.515617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.515907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.516190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.538859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:19.540094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:19.616905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b234e-9ce1-487c-bd3c-76bf53495c75 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:19.648736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 358/726] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 12:04:19.658910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:19.659711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.660000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.660279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.671475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:19.674068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:19.679283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:19.680231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:19.681104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 369/727] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:19.690790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:19.754464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:19.774253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:19.783774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce8498-bcec-4d7f-af0e-799f86d49999 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:19.798410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac487ef-d087-45f2-a550-bc4b7737dd45 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:19.820642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:19.821566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.821878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.822158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.833556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:19.840980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:19.841649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.841975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.842258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.843022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:19.843335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:19.844723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:19.846020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:19.847215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:19.848427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 359/728] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:19.853357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:19.854576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 370/729] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:19.864391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:19.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cdb0e-13b7-4ddf-a471-ac7560a9e70d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:19.995803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:19.996482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:19.996769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:19.997048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:19.997819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:19.997947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7732b-7b45-40e9-8dc3-eb27acefb920 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:19.998152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:19.999556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.008798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 360/730] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:20.009494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:20.014674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.038232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.039081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.039381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.039663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.040424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:20.052590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.054138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:20.078661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:20.079569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:20.080470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:20.080470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:20.080470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:20.080470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:20.080470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 371/731] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:20.087555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.195002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c79ab-42d0-4306-91cc-db06ff424734 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.249193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d3989-b026-41eb-b317-9924ffa70004 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.287664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.288682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.289168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.289665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.290750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:20.291310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.292911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.305983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 372/732] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:20.311133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.315696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.315959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.316180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.316457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.344496 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:20.347579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.349072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:20.380734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:20.381702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:20.382687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:20.382687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:20.382687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:20.382687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:20.382687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 361/733] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:20.388819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.473173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e475-022a-4af5-a058-2ed57d0b8519 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.491190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:20.541052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.542998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.543281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.543559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.555522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9ede3-ebc4-4a9d-89c9-e0eff9b755cc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.558681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.560145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-ef30f48e-7b4d-406a-8248-a1b2f21d3b05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:20.584158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:20.585184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:20.586191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:20.586739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 373/734] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:20.587748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aa84-6214-4720-9cff-d83df61553ce None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.588095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aa84-6214-4720-9cff-d83df61553ce None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.588382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6aa84-6214-4720-9cff-d83df61553ce None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.589836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 374/735] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:20.598449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6aa84-6214-4720-9cff-d83df61553ce None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.616398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.617685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.618206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.618709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.620631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:20.621157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.623241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb4d29-326a-4886-be1c-4df627499264 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.640306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 362/736] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:20.642018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.642521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.642997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.665001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:20.666851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:20.696044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:20.720658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6aa84-6214-4720-9cff-d83df61553ce None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.747653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 363/737] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 12:04:20.748792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.780162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.780992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.781632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.782081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.783480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:20.783897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.785488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.810285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 375/738] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:20.811315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.827989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:20.874311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647fc81-684d-4dca-8f9c-7a573f3947a3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.912507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.914194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.914876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.915318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.917560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb7f06-89ce-4db3-a86c-cda486f24e1f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:20.924671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.926443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:20.947984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:20.949244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:20.950260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:20.951960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 364/739] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:20.952672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:20.965654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:20.966365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:20.966654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:20.966938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:20.967673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:20.969071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.030393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.035637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 376/740] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:20 2022] POST /identity/v3/services => generated 240 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:21.036522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.094778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d8be8-0419-4f7f-8426-acd9b1fd6288 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.125146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.151341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84795139-42e1-4306-8e61-61cac3970b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.152437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84795139-42e1-4306-8e61-61cac3970b3d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.153289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84795139-42e1-4306-8e61-61cac3970b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.153690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84795139-42e1-4306-8e61-61cac3970b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.207549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6f82-773f-4efb-bba3-dfc97eca2f5e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.242112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84795139-42e1-4306-8e61-61cac3970b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.243746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84795139-42e1-4306-8e61-61cac3970b3d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.248959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.249641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.249961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.250235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.251067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:21.251374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.253226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117fbd-f281-4617-8b72-5a1aeabd78a5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.283738 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 377/741] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:21.285080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cd52-12a2-4a14-b91c-6b33fc67e911 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.285364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cd52-12a2-4a14-b91c-6b33fc67e911 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.285640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35cd52-12a2-4a14-b91c-6b33fc67e911 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.287272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 378/742] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:21.293149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cd52-12a2-4a14-b91c-6b33fc67e911 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.355984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.357855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 365/743] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:04:21.359233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.359581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.359864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.377401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:21.378629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:21.392673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.412302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35cd52-12a2-4a14-b91c-6b33fc67e911 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.452927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.454189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.454681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.455256 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.457834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 366/744] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:21.459021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.467642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.469398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:21.496523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:21.497516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:21.498467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:21.498467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:21.498467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:21.498467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:21.500922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 379/745] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:21.501990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.569102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a181c1-3c94-43c6-9c62-c6614283bb1d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.607305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.608031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.608338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.608572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.613974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f08c2f-1ec1-49e1-928e-f759bacf2a96 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.620539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.622025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.624706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.627801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:21.641845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:21.642815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:21.643732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:21.643732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:21.643732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:21.643732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:21.643732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 367/746] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:21.644458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.657754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.659044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.659536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.660018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.672448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:21.681167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:21.682214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:21.683173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:21.685759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 380/747] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:21.686798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.756676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd31e39-644b-4512-ad10-144d22476cc1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.797570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.798274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.798557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.798834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.799262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b704b-e670-4211-a56b-c32c0500b795 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.799561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:21.799866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.801410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.815070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 368/748] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:21.816049 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.838572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.839583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.840166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.840660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.841743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:21.842278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.843965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.858101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 381/749] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:21.859323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:21.879861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.898004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:21.928568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e67dcd-3c1d-477f-be9f-7cbfe44a2fb5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.966233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:21.967257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:21.967924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:21.968339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:21.969338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:21.969765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:21.971692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:21.977310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79143d2-2047-44ec-b074-8aa181594478 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:21.985674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 369/750] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:21.985674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.014365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.015169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.015441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.015715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.023419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.024863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-abc4b978-784f-471a-a5f9-9a7a1caff7ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:22.040601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:22.042421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:22.043337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:22.047381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 382/751] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:22.048761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494373ba-aa23-4b50-a176-5e840fd3992e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.049050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494373ba-aa23-4b50-a176-5e840fd3992e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.049325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494373ba-aa23-4b50-a176-5e840fd3992e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.050680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 383/752] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:22.055128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494373ba-aa23-4b50-a176-5e840fd3992e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.103237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca761d-f208-43d4-a761-d908c1104e88 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.122306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.139333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.140140 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.140429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.143503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.147895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.149384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.159654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:22.167839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:22.172696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:22.173915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:22.174572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 370/753] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:22.175116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.175296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494373ba-aa23-4b50-a176-5e840fd3992e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.210233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.211026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.211320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.211596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.223024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.224495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c777487f-d9d3-4dde-a423-f3695090e9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:22.243392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:22.244807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:22.245901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:22.245901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:22.245901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:22.245901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:22.249279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 384/754] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:22.250643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.250937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.251221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.268570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:22.269752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:22.288000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe3ea1-8217-4aa3-b847-94c0832fd507 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.326303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.326979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.327269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.327550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.328768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:22.329225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.330720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.350896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 385/755] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:22.351105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 371/756] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:22.351105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.351247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.396124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.425475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.458889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f0bc9-cb6e-4e63-8205-534d1cc2ea8a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.462640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed95031-18f9-4c5f-823d-91618fe598a4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.495031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.495693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.495980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.496262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.497071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:22.497354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.498815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.498986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.499649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.499943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.500234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.500949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:22.501552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.502644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.516119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 386/757] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:22.516119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.524313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 372/758] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:22.525052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.622595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20babf8-af03-445a-a4a5-ef7624037978 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.626266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.630041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463267b-7095-4e51-b8e2-bbedd3dbcd8b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.657004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.662821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.664020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.664553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.676146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/75c9161930b64f0e910a4a3323fa733a/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.676298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.676423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=75c9161930b64f0e910a4a3323fa733a, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.676516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.676516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.676516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.676753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.676835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.676835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:22.685361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:22.686523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:22.687470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 373/759] 10.222.0.64 () {56 vars in 1129 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:22.688532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.754228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 387/760] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:22 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/75c9161930b64f0e910a4a3323fa733a/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:22.755268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.798409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122da919-09d5-40fa-b0e2-e1dd367023b0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.840581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.842323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.843143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.843667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.845698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=5c26b297875b47bf8b14775b4fb63c9f) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:22.846578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.848986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.859164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 374/761] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/role_assignments?user.id=5c26b297875b47bf8b14775b4fb63c9f&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:22.860533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:22.894407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2d868-302e-467d-b37e-12e10752d6ba None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:22.905528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:22.938595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:22.939359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:22.939626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:22.939904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:22.948933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:22.950484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:22.982891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:22.984333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:22.985297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 388/762] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:22.990847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.013742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c3c8d-7a00-4322-afbc-f7bff0562f81 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.055818 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.056504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.057442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.057877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.058942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:23.059372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.060881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.062090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.073094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 375/763] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:23.074791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.135199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc46d78-1b41-4aea-9a74-79374cac4465 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.174639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.175334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.175619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.175900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.176440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.178079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:23.178552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.180200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.185933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3352d51b-9ab2-48bf-92a7-49f9e3db50ea None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.200282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 389/764] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jun 20 12:04:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:23.205946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.230330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.231017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.231594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.231874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.232593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:23.233068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.235319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.247820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 376/765] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:23.251204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.356399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba533e8-79c5-48d8-a623-667288e1a030 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.368210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.392249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e773c-1409-4125-bd16-b343430af5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.392986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e773c-1409-4125-bd16-b343430af5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.393460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e773c-1409-4125-bd16-b343430af5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.393817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e773c-1409-4125-bd16-b343430af5a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.398449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189db94-3a14-4d96-a39c-226afd74fe99 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.443672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.444357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.445537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.445841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.446668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] RBAC: Adding query filter params (interface=public, service_id=f29a480582e64475804be861cfa4dfe7, region_id=RegionOne) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:23.446985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.448430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438b99a-162c-4d44-a4cc-dbe106955f63 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.459287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 377/766] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/endpoints?service_id=f29a480582e64475804be861cfa4dfe7&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:23.460618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83ecc-5497-498f-a0d8-9dec64e2d643 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.460912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83ecc-5497-498f-a0d8-9dec64e2d643 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.461195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f83ecc-5497-498f-a0d8-9dec64e2d643 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.465893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 378/767] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:23.466770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83ecc-5497-498f-a0d8-9dec64e2d643 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.493040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e773c-1409-4125-bd16-b343430af5a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.495205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.495591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e773c-1409-4125-bd16-b343430af5a9 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.605416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 390/768] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:04:23.607147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.607570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.608026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.611963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f83ecc-5497-498f-a0d8-9dec64e2d643 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.627686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:23.629179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:23.633519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.660734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.661785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.662722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.663149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.665166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.667191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.674668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 379/769] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:23.675661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.746424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 391/770] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:23.789687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.803022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:23.848158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4beac6-db85-4f42-92b7-72a111d366cd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.906133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.906927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.907213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.907501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.921320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.922639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.931042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8cd0f-b1a4-4752-abfe-f74107013d06 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:23.942250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:23.943191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:23.944105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:23.944105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:23.944105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:23.944105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:23.944105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 380/771] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:23.949741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:23.973628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:23.974831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:23.975297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:23.975750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:23.976668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:23.979174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:23.991482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:23.992888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:23.993754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:23.996838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 392/772] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:24.003274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.007692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:24.065248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c0311-0fc3-4750-9a1a-22ddd0679dbb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.105635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.106429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.106925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.107204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.108211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:24.108510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.110031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.111903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:24.115111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee5aa0-6465-40a0-9be4-5acea0bb19a8 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.125302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 381/773] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:24.130449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.157833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.158898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.159376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.159842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.160721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:24.161302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.162944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.169562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 393/774] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:24.176069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.261825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b96a1e-3fb1-4359-b832-384c2cbbbad6 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.300555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:24.303791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.304738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.305021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.305297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.317828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.317828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:24.332767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:24.333742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:24.334709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 382/775] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:24.340913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.378006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66376fcd-14bb-4fa1-ac56-df07c0066fa3 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.452158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.453037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.453323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.453595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.455585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] RBAC: Adding query filter params (type=network) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:24.455898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.456303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:24.457266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.466778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 394/776] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:24.473276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.550627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710922bc-b26c-4c56-a10c-58840a2ee2ec None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.597625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.598327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.598613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.598893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.599738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:24.600051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.601541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.621152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 383/777] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:24.626554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.662164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6519c5e-c24d-44f3-9d7b-4df245727c46 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.717140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:24.725448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.726147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.726431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.726708 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.727503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] RBAC: Adding query filter params (interface=public, service_id=e30761d15f4f489591a045936d7c13a6, region_id=RegionOne) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:24.727816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.729726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.746499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 395/778] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/endpoints?service_id=e30761d15f4f489591a045936d7c13a6&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:24.754604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:24.810541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305695-a778-44fe-a18a-9d81e345e956 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.838934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:24.875573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.876238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.876525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.876804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.877646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=f5270f6d342b4ec08c27b7d8de8a0a89) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:24.877991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.879446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ac91-4207-46a6-a908-de7c9fae6c7d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.891989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 384/779] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/role_assignments?user.id=f5270f6d342b4ec08c27b7d8de8a0a89&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:24.925933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626093a-d2c1-4123-81e2-781d86770cee None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:24.985919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6070b-1010-4072-8ab1-9bbc8a42b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:24.986596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6070b-1010-4072-8ab1-9bbc8a42b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:24.986881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6070b-1010-4072-8ab1-9bbc8a42b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:24.987157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6070b-1010-4072-8ab1-9bbc8a42b3b1 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:24.987860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6070b-1010-4072-8ab1-9bbc8a42b3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:24.989352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6070b-1010-4072-8ab1-9bbc8a42b3b1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:24.996707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 396/780] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:24 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:25.161885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48dd1c-2e90-45f8-8974-90412bf4aced None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:25.162872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48dd1c-2e90-45f8-8974-90412bf4aced None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:25.163358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48dd1c-2e90-45f8-8974-90412bf4aced None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:25.165110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 385/781] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:25.171028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61f364-d992-43db-ae1f-8e566625f15c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:25.171644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61f364-d992-43db-ae1f-8e566625f15c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:25.172098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61f364-d992-43db-ae1f-8e566625f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:25.194022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-fe61f364-d992-43db-ae1f-8e566625f15c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:25.195613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-fe61f364-d992-43db-ae1f-8e566625f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:25.267386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:25.286147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 397/782] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:25.312573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48dd1c-2e90-45f8-8974-90412bf4aced None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:25.457208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48dd1c-2e90-45f8-8974-90412bf4aced None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:25.513624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:25.514733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:25.515171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:25.515595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:25.535025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357674f-3366-4bee-b8f8-38d730c6784d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:25.535672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357674f-3366-4bee-b8f8-38d730c6784d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:25.536318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357674f-3366-4bee-b8f8-38d730c6784d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:25.536702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:25.542987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 398/783] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:25.545567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:25.547655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:25.549481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 386/784] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:25.550248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:25.550248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:25.550248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:25.557501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:25.582293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:25.583556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:25.634188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:25.717019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 399/785] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:25.735186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bc311-4548-47de-ad30-c43c4205bb28 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:25.761166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:25.803639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:25.804324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:25.804612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:25.804895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:25.806311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:25.806927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:25.808468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:25.830850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 387/786] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:25.837204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:25.945199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d0427-a895-4822-bc0c-6187786ae5f7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:25.998263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.011467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.012373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.012712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.012941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.029087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.035003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c4d03-63f8-4f1f-86ad-81f77302478f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.037925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:26.050162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:26.051170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:26.052444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 400/787] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:26.059331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.102218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.103075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.103875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.104211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.124730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.126244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:26.161604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:26.163060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:26.164577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:26.164577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:26.164577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:26.164577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:26.164577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 388/788] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:26.170558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.252056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66e6cc-3e5f-438b-a211-f9180766fe16 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.311839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.312545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.312832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.313214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.314009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:26.314325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.315735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.325191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 401/789] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:26.330817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.402219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.415826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f977-4876-4044-8392-7f3d4c6c5b52 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.439606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af8207-08f6-4903-bb49-d518df7a3413 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.488174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.489217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.489493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.489771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.493791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.495241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.495726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.496208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.497144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:26.497646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.499631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18bf43-0882-4898-bc4b-241f85707609 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.502695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.504721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.516227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 389/790] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:26.518479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ed5c-f840-4c72-90be-6993c2b9fb20 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.518983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ed5c-f840-4c72-90be-6993c2b9fb20 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.519439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ed5c-f840-4c72-90be-6993c2b9fb20 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.525954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 390/791] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:26.526114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:26.526956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:26.528079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:26.528079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:26.528079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:26.528079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:26.528079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 402/792] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:26.529166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.531185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.531649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.532410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.554040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:26.555991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:26.566401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.646268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 391/793] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:26.646806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.659085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.672837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf223bf-f375-4941-939c-2907ea1aaee6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.710032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.711215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.711724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.712194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.721659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.723588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:26.739451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:26.740448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:26.741411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:26.744803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 403/794] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:26.746167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.763874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09edf46-2098-498c-af52-28f93bdadc6d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.801437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.802159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.802447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.802778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.803550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:26.803861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.805255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.818666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 392/795] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:26.819507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.822765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.861198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d96ba-c5a9-4fb8-903e-b7a5fab7426f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.900128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.901778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.902318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.902898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.903778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.905735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:26.919807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:26.920798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 12:04:26.921647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:26.929293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 404/796] 10.222.0.64 () {56 vars in 1129 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:26.929617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010b8da-7a7c-4dc5-b889-a7eed15db7dc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:26.930664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:26.952896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:26.968256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:26.969114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:26.969501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:26.969913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:26.970862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:26.971285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:26.972825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:26.992331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 393/797] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:26.994622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.045397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43237e-29b5-4b73-87a0-e249ea17ca76 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.059908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.085122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.086237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.086666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.087137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.096672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.098518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:27.114653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:27.115657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:27.116603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:27.117153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3911df-ad92-473a-ac7d-09456698b87f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.120245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 405/798] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:27.121398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.155460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.156246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.156684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.157036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.157995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:27.158371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.159859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.166758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 394/799] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jun 20 12:04:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:27.166758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.217648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.242086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7827-5cec-487f-920c-c376f4851040 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.276618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab66971-1f96-4732-b209-8ce6507c33b5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.281009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf770bd-c133-4fe5-add0-a0dcb19a9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.281933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf770bd-c133-4fe5-add0-a0dcb19a9c71 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.282429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf770bd-c133-4fe5-add0-a0dcb19a9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.282884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf770bd-c133-4fe5-add0-a0dcb19a9c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.303553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.317443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.318152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.318436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.318738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.319557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:27.319872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.321306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.340505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 395/800] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:27.340919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.366329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf770bd-c133-4fe5-add0-a0dcb19a9c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.367811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf770bd-c133-4fe5-add0-a0dcb19a9c71 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.448996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.456892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c1f6-80b5-44e0-87df-ff066038548d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.474108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 406/801] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:04:27.475555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbaee3-99e8-4fd7-904f-f23592f22b8b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.475849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbaee3-99e8-4fd7-904f-f23592f22b8b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.476124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbaee3-99e8-4fd7-904f-f23592f22b8b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.481633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 407/802] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:27.482108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbaee3-99e8-4fd7-904f-f23592f22b8b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.496952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.497628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.497962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.498247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.498960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:27.499272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.500654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.505411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 396/803] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:27.506211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.552971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.586031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bbaee3-99e8-4fd7-904f-f23592f22b8b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.606755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7445b3-47f6-4610-acad-6de374b62666 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.621246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.622074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.622358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.622634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.632777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.634279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.640660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.641460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.641750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.642062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-930e3b7b-40ff-475c-9cd3-1d4bdbc04024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:27.652174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:27.653136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:27.654061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:27.654061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:27.654061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:27.654061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:27.654555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.654630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 408/804] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:27.654698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.654961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.655203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.655461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.673494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:27.674727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-e5bcf190-9a79-4d05-8540-12aa2bac4410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:27.676510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:27.677603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:27.678796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:27.678796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:27.678796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:27.678796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:27.678796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 397/805] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:27.679139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4ac2-1ae0-4989-a68b-8b07390f367d None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.679220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4ac2-1ae0-4989-a68b-8b07390f367d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.679502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad4ac2-1ae0-4989-a68b-8b07390f367d None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.681304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 398/806] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:27.681488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad4ac2-1ae0-4989-a68b-8b07390f367d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.702997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.746148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 409/807] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:27.747084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.790306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.795148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad4ac2-1ae0-4989-a68b-8b07390f367d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.830029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228536f-d550-4faf-ac70-71adf5c3df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.830690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228536f-d550-4faf-ac70-71adf5c3df31 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.830967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228536f-d550-4faf-ac70-71adf5c3df31 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.831239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228536f-d550-4faf-ac70-71adf5c3df31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.831977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228536f-d550-4faf-ac70-71adf5c3df31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.833346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228536f-d550-4faf-ac70-71adf5c3df31 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.848338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aab4ce-6115-4764-9b2c-a1d102403ce5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:27.881007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:27.881664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.881979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.882266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.882983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:27.883293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:27.885262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:27.896569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 410/808] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:27.897362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:27.913991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 399/809] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:27.915350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:27.915646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:27.916502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:27.934304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:27.935925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:27.937203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:28.022434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 400/810] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:28.023321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.033453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e433-7adb-48bf-b340-a3fcf746ff15 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.077334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.078036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.078318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.079174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.079311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:28.079619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.080996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.095035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 411/811] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:28.097917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.132691 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.152102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e058dc-358a-456b-9c4e-fa718804b060 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.188887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.190614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.190901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.191181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.192173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.202095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:28.209931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:28.210924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:28.211883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:28.212544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dd3c1-44bd-4dbd-837e-1fe2b56fddcd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.216814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 401/812] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:28.217545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.251054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.252019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.252309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.253372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.261727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.263234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:28.277844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:28.278804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:28.279986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 412/813] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:28.280480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.325701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f08cd-06fe-440d-a35a-3f6040853f73 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.360682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.361490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.361774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.362156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.362795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.364217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:28.376253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:28.377317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 12:04:28.378241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:28.382433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 402/814] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:28.383224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.387442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.389193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39938e8f-70cf-4f37-890d-fdb4e8005b3d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.424868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.425671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.425994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.426278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.433811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.435284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.438007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:28.451143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:28.457724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 413/815] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:28.458670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.500980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3e317-4a9f-4a46-8b79-29fe7d0717e7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.535899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.536568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.536853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.537129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.537896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:28.538206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.539581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.548321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 403/816] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:28.549322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.559111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd28879-c0be-4e1e-af65-7cd57b9eaadd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.598815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.599589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.599879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.600150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.600931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:28.601240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.602830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.615770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.622128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 414/817] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:28.622128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.662212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518180-0477-4895-b8f2-c08b13c052d1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.700225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.700922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.701211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.701497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.702257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] RBAC: Adding query filter params (name=network) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:28.702575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.703994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.714607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 404/818] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:28.714607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.795843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.818853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf8dee-6704-4a42-b9c5-1567c8ebd91c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.841990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf1fb7-293d-423d-9588-a8d64d257464 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:28.851179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:28.858610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.859412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.859699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.859980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.871684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.873158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.877950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:28.878663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:28.878945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:28.879218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:28.880018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:28.880296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:28.881712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:28.891167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:28.892068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:28.893075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:28.893075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:28.893075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:28.893075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:28.893075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 405/819] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:28.893075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:28.905422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 415/820] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:28.905422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.000701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29563f0-ac57-4dd7-a42b-7bc61fbec848 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.014890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad48a5-f625-4602-b438-7fc39e86cd69 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.036032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.038650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.039629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.040002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.040347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/5c26b297875b47bf8b14775b4fb63c9f/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.042559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=5c26b297875b47bf8b14775b4fb63c9f, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.044188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.050856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.051517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.051837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.052065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.052763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] RBAC: Adding query filter params (type=network) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:29.053067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.054441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.060563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 416/821] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:29.061392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.126191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 406/822] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:28 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/5c26b297875b47bf8b14775b4fb63c9f/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:29.127223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.189308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be727-ef04-402e-964a-eba62bf4766b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.196676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.232743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.233873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.234370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.234823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.235714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:29.236184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.237593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.260263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 417/823] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:29.260263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.285489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465a49c-91e2-4757-80a4-b752d7649dcb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.317200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.332927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.333595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.333921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.335038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.335132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=75c9161930b64f0e910a4a3323fa733a) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:29.335389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.336833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.346696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 407/824] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:29 2022] GET /identity/v3/role_assignments?user.id=75c9161930b64f0e910a4a3323fa733a&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:29.347534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.381551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa270e3-1b32-4eb6-b8a9-e16079f1a698 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.462228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.463850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.464370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.464843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.465795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.469315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.519190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc0334-41f0-4aaa-9174-e87705f3a326 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.528855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.556144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.557598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.558015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.558329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.566505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.567900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.577332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 418/825] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:29.593059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:29.594136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:29.595135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 408/826] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:04:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:29.600277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.718073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:29.734421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd56d7-cb36-489f-99ba-9896d0b420ef None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.779699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.780319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.780598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.780873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.781720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:29.782053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.783533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:29.808719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 419/827] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jun 20 12:04:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:29.813792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:29.927672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8fe87-3651-4a66-b02b-9450773fb770 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:29.968197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:29.969434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:29.969993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:29.970521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:29.983436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:29.985246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:30.007098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:30.008071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:30.008985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:30.008985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:30.008985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:30.008985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:30.012302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 409/828] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:30.018905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.128331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67988-17ef-477b-8d2c-b506c0b2c05f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.164750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.165418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.165698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.166022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.166837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:30.167144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.168518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d6149-25d0-4ad5-96b0-b83a6d660442 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.180700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 420/829] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:30.186444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.191409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91c826-fb6a-4415-add2-aaf2fab631a7 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.191885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91c826-fb6a-4415-add2-aaf2fab631a7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.191986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91c826-fb6a-4415-add2-aaf2fab631a7 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.194557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 421/830] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:30.199224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.199224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.199457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.214223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:30.219451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:30.220868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:30.231549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:30.300313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 422/831] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:30.308493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f580ce3-813a-40df-866e-deded5817155 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.323276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.350715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.352480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.353006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.353700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.362848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.365067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:30.385238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:30.386344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:30.387269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:30.387723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 410/832] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:30.394932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.438221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aed34-d78e-4484-a304-ab051d73cdf3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.474325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.475133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.475420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.475700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.476361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.477747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.488302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:30.490169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:30.491179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:30.492058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:30.497092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 423/833] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:30.498499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.509896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:30.516717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d6d91-41df-4a0f-9d19-ddcea4393376 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.555566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.557136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.557599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.558012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.559013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:30.559491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.561110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.579060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 411/834] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:30.580073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.605580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd602121-b921-4f6c-9e9e-3008809b0292 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.641119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.642161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.642655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.643140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.644067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:30.644578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.646188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.656506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 424/835] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:30.657961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:30.690986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849f303-38dc-4060-805b-b049bd39f7e4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.730240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9dc10-4ecc-4fd3-9230-bbfd25c54d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.731056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9dc10-4ecc-4fd3-9230-bbfd25c54d89 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.731345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9dc10-4ecc-4fd3-9230-bbfd25c54d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.731628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9dc10-4ecc-4fd3-9230-bbfd25c54d89 None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/f5270f6d342b4ec08c27b7d8de8a0a89/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.733707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:30.742012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:30.750077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9dc10-4ecc-4fd3-9230-bbfd25c54d89 None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=f5270f6d342b4ec08c27b7d8de8a0a89, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.751864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9dc10-4ecc-4fd3-9230-bbfd25c54d89 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.768487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd489a-0e7b-472a-a1fa-621ac51ce594 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:30.805321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:30.806122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:30.806472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:30.806751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:30.807459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:30.807768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:30.809134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15c162-96ae-4b02-8195-d586d685a726 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:30.814069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 425/836] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:30.824702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 412/837] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:30 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/f5270f6d342b4ec08c27b7d8de8a0a89/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:04:31.382620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341db7f-3619-41e4-8310-2260c1bb80a9 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:31.383136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341db7f-3619-41e4-8310-2260c1bb80a9 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:31.383136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341db7f-3619-41e4-8310-2260c1bb80a9 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:31.385251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 426/838] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:31.390627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:31.391042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:31.391208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:31.408625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:31.409840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:31.479632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 413/839] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:31.503822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341db7f-3619-41e4-8310-2260c1bb80a9 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:31.618232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341db7f-3619-41e4-8310-2260c1bb80a9 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:31.655025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf218a89-2480-46cb-aea9-d925c6ab20be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:31.655740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218a89-2480-46cb-aea9-d925c6ab20be None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:31.656027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218a89-2480-46cb-aea9-d925c6ab20be None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:31.656304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218a89-2480-46cb-aea9-d925c6ab20be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:31.659100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:31.668923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf218a89-2480-46cb-aea9-d925c6ab20be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-cf218a89-2480-46cb-aea9-d925c6ab20be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:31.676945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:31.677944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:31.679379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 427/840] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:31.684257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:31.722524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247a68-25b5-4b11-8f68-37634be8536e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:31.722837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247a68-25b5-4b11-8f68-37634be8536e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:31.723097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247a68-25b5-4b11-8f68-37634be8536e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:31.724772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 428/841] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:31.731779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:31.732258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:31.732606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:31.752363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:31.753542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:31.794034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22bb8a4-93c2-4b4c-b4bf-dbf9ee7b765a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:31.814006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:31.828461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 429/842] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:31.839539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:31.840455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:31.840916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:31.841391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:31.842504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:31.843145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:31.845434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:31.852236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:31.859148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 414/843] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:31.865371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:31.965321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50634c00-a6a3-487a-8064-626d86ee0137 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:31.973340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86727554-9ed6-4e33-974e-b2d615bcad0d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:31.994596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.005680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.008354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.008354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.008354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.008354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.010218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.013075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.014681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.015122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.015668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:32.024088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:32.026093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:32.027238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:32.035160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 430/844] 10.222.0.64 () {56 vars in 1132 bytes} [Mon Jun 20 12:04:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:32.038093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.039377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:32.039588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:32.060987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:32.062001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:32.062902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:32.062902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:32.062902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:32.062902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:32.073060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 415/845] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:32.073842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:32.113298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.167423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe255f4-877e-4aec-8d9d-78cc07fa5389 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:32.204194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.204854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.205137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.205402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.206168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:32.206477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.207890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.217603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 431/846] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:32.218670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:32.223328 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5ee67-7d5a-4753-b009-319dce2f317d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:32.270111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.271550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.272148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.272631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.274087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:32.274608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.276711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.279023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.296655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 416/847] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:32.297652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:32.336355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182b9d5-c9c6-49ad-aec3-635ad8149b8f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:32.383736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.385991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.386931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.387396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.388533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:32.389304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.391288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.397354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.403823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 432/848] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:32.412472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fd616-461a-47cf-a007-41d08d9bfab8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:32.452602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.453413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.453694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.454877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.464834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.466412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:32.483407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:32.484598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:32.485557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 417/849] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:04:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:32.490960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:32.613415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a202-af86-4d33-826b-d342f6f929bf None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:32.632127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.649888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.650683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.650968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.651255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.652083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:32.652392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.653890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df688a1-c6a0-49dc-9b9f-72971ccb00d2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.673449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 433/850] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jun 20 12:04:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:32.679462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:32.793273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e0d43-6ec8-43f5-99ac-4513f69f2a08 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:32.830956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fac1fb-20bf-4d82-bbac-26868def766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:32.831624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac1fb-20bf-4d82-bbac-26868def766c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.831919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac1fb-20bf-4d82-bbac-26868def766c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.832204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac1fb-20bf-4d82-bbac-26868def766c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.857106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:32.907669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fac1fb-20bf-4d82-bbac-26868def766c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:32.909160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fac1fb-20bf-4d82-bbac-26868def766c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:32.970838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328cfed-432c-4daa-a487-53f339cdda58 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.971150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328cfed-432c-4daa-a487-53f339cdda58 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.971750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328cfed-432c-4daa-a487-53f339cdda58 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.977363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 434/851] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:32.980091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8eae-ca1f-46ff-9608-1f62c36378aa None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.980388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8eae-ca1f-46ff-9608-1f62c36378aa None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.980666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8eae-ca1f-46ff-9608-1f62c36378aa None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:32.982167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 435/852] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:32.983112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:32.983397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:32.983675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.002446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:33.003636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:33.024857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 418/853] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:04:33.024857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.024857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.024857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.040781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:33.042014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:33.083445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 436/854] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:33.090753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.206145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474fcba-2f35-4f41-8a9f-81c6798cf394 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.214350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.217323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.241853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 419/855] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:33.241853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.251247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.253152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.254143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.254578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.271062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:33.273194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:33.296730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:33.297872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:33.299027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:33.299027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:33.299027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:33.299027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:33.304717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 437/856] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:33.304717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.358300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b22a2-b29d-4a1c-bb13-504e095a1bf4 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.394565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.395230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.395570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.395971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.396819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:33.398225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:33.402689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134d1bf-8cb3-4fb4-b5d3-da683a5d93c4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.436850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.437639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.438035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.438322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.449110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:33.457023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:33.458310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:04:33.459226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:33.462237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 420/857] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:33 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:33.463338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.464161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 438/858] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:33.465295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.495678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.535730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.605338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0033b1-798e-484e-9c04-ea52e0f2fa99 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.636587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c90053-9ea5-4698-a0d5-ba59da061972 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.652718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.652936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.653529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.653529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.656102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:33.656102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:33.657439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:33.669864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 439/859] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:33.672679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.679230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.680115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.680402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.680682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.681499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:33.682087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:33.683546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:33.696284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 421/860] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:33.703066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.760627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.788113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcbfa1-a29d-45d8-a211-cc35ab732d76 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.825828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.826686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.826974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.827448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.833642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:33.838890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:33.840084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609b35e-0105-4ab9-936a-537c22d3eee7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:33.840357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:33.867051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:33.868037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:33.869580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:33.869580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:33.869580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:33.869580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:33.873662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 440/861] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:33.875749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:33.891676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:33.893063 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:33.893582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:33.894563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:33.906957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:33.908417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:33.927602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:33.928539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:33.929447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 422/862] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:33.936593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.002949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7de4-eaab-48c9-9575-681ab22a4856 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.035548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.041572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.042273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.042555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.042833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.043562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:34.043871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.045567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.062141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 441/863] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:34.064034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.083742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690a2be-315e-44ea-861b-a3427ae97f74 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.130053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.131656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.132426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.132934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.134122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:34.134930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.136909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.159296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 423/864] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:34.160959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.185832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.189923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde0ce7-aeaa-407d-a1a0-d91deaeabad6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.235921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.236742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.237026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.237299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.247161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.249249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:34.269453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:34.270512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:34.271476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:34.275365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 442/865] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:04:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:34.276224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.304593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84271996-424e-4029-9782-6d2045eb5120 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.342233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.352653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.354226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.355103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.355596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.357023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=5c26b297875b47bf8b14775b4fb63c9f) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:34.357600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.359897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.369341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 424/866] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:34 2022] GET /identity/v3/role_assignments?user.id=5c26b297875b47bf8b14775b4fb63c9f&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:34.398799 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d645850-3873-488d-80de-1bd45abeda7a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.441003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.442513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.443031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.443519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.444609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:34.445151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.447436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a09d2e-2875-4aa3-bdf2-24e8971e949c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.468796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 443/867] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jun 20 12:04:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:34.474963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.569673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836b37-84a3-43cc-a305-9335cda478ea None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.569996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836b37-84a3-43cc-a305-9335cda478ea None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.570283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a836b37-84a3-43cc-a305-9335cda478ea None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.570786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.572536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 444/868] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:34.577785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.578103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.587105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.594783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dd6a-fb76-475f-bdb3-5d6923c6e3ea None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.598648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:34.600078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:34.632313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.632967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.633247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.633520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.695272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 445/869] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:34.723991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.727203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.729424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.768507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.819767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:34.829209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48e6b2-6962-4a8c-b088-bbc92cf5089b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.841870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 425/870] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:34 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:04:34.851211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:34.869519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.870217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.870504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.870783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:34.871525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:34.872908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:34.953494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690a964-6595-4c52-b509-4b3e15f71051 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:34.979406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 446/871] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:34 2022] POST /identity/v3/services => generated 269 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:04:34.995993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:34.996868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:34.997160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:34.997440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.010614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:35.012186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:35.032962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:35.033954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:35.034870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:35.034870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:35.034870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:35.034870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:35.034870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 426/872] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:35.040102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:35.156371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:35.161519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250d6c-dc51-45f4-a18b-88e405a9e563 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:35.199432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:35.200108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.200397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.200675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.201405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:35.201713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:35.203152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:35.216668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 447/873] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:35.222128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:35.256902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:35.329958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6eb380-6715-4456-a1eb-8e996786d27e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:35.365756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:35.366974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.368749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.370042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.377492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:35.379217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:35.393428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:35.394403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:35.395335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:35.397759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 427/874] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:35.409857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:35.516526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43c955-2a14-4f2b-9bb6-36d372ce4cc1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:35.552916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:35.553642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.553962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.554241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.555083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:35.555400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:35.557365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16928a-a035-4098-a534-f2f44b1409b7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:35.574165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 448/875] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:35.575772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:35.660800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0971269-749f-4835-a8ca-ac25b0c438f4 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.661006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0971269-749f-4835-a8ca-ac25b0c438f4 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.661149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0971269-749f-4835-a8ca-ac25b0c438f4 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.662839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 449/876] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:35.668623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.668919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.669201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.677538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:35.686001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:35.687200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:35.687834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ff1a9-0482-4370-8fbd-ee6e1d65cb09 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:35.702210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:35.731750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:35.733301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.733796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.734333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.735748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=f5270f6d342b4ec08c27b7d8de8a0a89) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:35.736590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:35.738582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:35.746602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 428/877] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:35 2022] GET /identity/v3/role_assignments?user.id=f5270f6d342b4ec08c27b7d8de8a0a89&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:35.768104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 450/878] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:35.792891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:35.905198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd7cec-0537-47ba-a32d-ac4e5e55e1bc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:35.941212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:35.942060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:35.942344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:35.942624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:35.943281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:35.944748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:35.957216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:35.958236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:35.959090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 429/879] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:35.966330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:36.073825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555b7b-4cb5-4f4c-b8bc-1c2dcfc2d262 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:36.108095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:36.108756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.109047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.109534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.110269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:36.110636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:36.112010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:36.117166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 451/880] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:36.123043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:36.144624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:36.237995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc4cb5-89ee-4770-bdf3-af26bdbe0a97 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:36.273687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:36.274439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.274729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.275583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.276303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:36.276614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:36.278079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:36.283768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 430/881] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:36.289573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:36.307010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:36.393475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466df2b-2741-4bbe-acfb-9e664ae23ac3 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:36.428620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:36.429704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.430273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.430733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.432466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] RBAC: Adding query filter params (interface=public, service_id=ec8a8413b12d4897ad3302ce2db50019, region_id=RegionOne) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:36.432965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:36.434588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdedc2-1afa-46c2-90b0-3e24ef500510 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:36.440372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 452/882] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:36 2022] GET /identity/v3/endpoints?service_id=ec8a8413b12d4897ad3302ce2db50019&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:36.446239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:36.531561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:36.550771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ceea1-aac9-403a-8ef3-27b8d5347318 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:36.589949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80bdaa-d796-4de5-a809-f6e261cd5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:36.590615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80bdaa-d796-4de5-a809-f6e261cd5ade None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.590909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80bdaa-d796-4de5-a809-f6e261cd5ade None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.591191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80bdaa-d796-4de5-a809-f6e261cd5ade None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.591884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80bdaa-d796-4de5-a809-f6e261cd5ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:36.593270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80bdaa-d796-4de5-a809-f6e261cd5ade None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:36.599651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 431/883] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:36 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:04:36.662152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b78670-3aea-4e21-a956-aa1e09f47a7b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.662657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b78670-3aea-4e21-a956-aa1e09f47a7b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.662657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b78670-3aea-4e21-a956-aa1e09f47a7b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.664305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 453/884] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:36.670698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.671034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.671266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.689957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:36.691205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:36.765606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 432/885] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:36.788578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b78670-3aea-4e21-a956-aa1e09f47a7b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:36.872713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:36.895612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b78670-3aea-4e21-a956-aa1e09f47a7b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:36.932648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:36.933482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:36.933762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:36.934101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:36.934766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:36.936139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:36.949523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:36.950652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:36.951532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 454/886] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:36.956897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:37.037911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:37.061768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e6d28-294e-4493-86ae-ef82d6359c6b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:37.101608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:37.102339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.102628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.102912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.103682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:37.103995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:37.105400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6823e-9c43-48f4-bef7-acf57bddbdac None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:37.111081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 433/887] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:37.116592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:37.204738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d25694-adc9-4a82-ad6d-c0a1a94195bb None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.205041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d25694-adc9-4a82-ad6d-c0a1a94195bb None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.205199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d25694-adc9-4a82-ad6d-c0a1a94195bb None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.207000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 434/888] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:37.215934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.216356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.216735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.236080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358da9-b4a1-47c2-a932-9a403513dcc5 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:37.236765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:37.239143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:37.280230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:37.281026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.281317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.281598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.282415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:37.282726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:37.284216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:37.290670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 455/889] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:37.328602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 435/890] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:37.352092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:37.363319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:37.469735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27708f-6083-4118-ab1e-5985c1686e5c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:37.505468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:37.506694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.507180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.507669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.508509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:37.511213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:37.523825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:37.524761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:37.526355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:37.533913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 456/891] 10.222.0.64 () {56 vars in 1132 bytes} [Mon Jun 20 12:04:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:37.535597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:37.618596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:37.653153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6a57a-d5c0-4a07-bb4c-a9d099db817e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:37.692163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:37.693198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.693686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.694191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.695100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:37.695633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:37.697793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:37.707437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 436/892] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:37.709087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:37.787666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:37.821630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8191a-0499-4a24-a2db-f77d85c11396 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:37.858972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:37.860012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:37.860495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:37.860968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:37.861964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:37.862484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:37.864069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:37.870718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 457/893] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:37.878731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:37.981320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f965a2-c139-43c2-a501-75c8a30f8b4f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:38.017163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:38.017853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.018144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.018426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.019221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] RBAC: Adding query filter params (interface=public, service_id=e90a8745588440b8b25ef94c2aa56608, region_id=RegionOne) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:38.019534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:38.020907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f9f90-dc3d-4d7c-a541-fc5b2633b84f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:38.022372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:38.027995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 437/894] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:37 2022] GET /identity/v3/endpoints?service_id=e90a8745588440b8b25ef94c2aa56608&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:38.033895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:38.105135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7b4b-7be4-42fc-adaf-96afbf31d85a None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.105776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7b4b-7be4-42fc-adaf-96afbf31d85a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.106290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7b4b-7be4-42fc-adaf-96afbf31d85a None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.111588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 438/895] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:38.113323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.113877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.114370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.132184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:38.133668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:38.151147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac656c3-8d30-404b-a3d0-8444f80e9fb3 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:38.198040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:38.198982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.199267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.199543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.200226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:38.202393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:38.203823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:38.210768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 458/896] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:38 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:04:38.217976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 439/897] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:38.237384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:38.356830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7894c-28cb-4109-ba4d-b3f2759db8ac None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:38.395864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:38.397053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.397545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.398062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.410335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:38.420127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:38.421178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:38.422150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:38.424357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 459/898] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jun 20 12:04:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:38.429468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:38.539054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c3593-532c-4153-aae0-b1e056febb61 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:38.567365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:38.575496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:38.576176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.576460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.576736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.577486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:38.577784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:38.588478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71a20b-d173-461a-98c7-178d64288491 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:38.589330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 440/899] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:04:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:38.594935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:38.659189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:38.706067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e01228-a38b-4db8-ae9a-071d1223597d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:38.735674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd13fe1-1222-4f36-8b6f-7db547ed066f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.736204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd13fe1-1222-4f36-8b6f-7db547ed066f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.736302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd13fe1-1222-4f36-8b6f-7db547ed066f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.741489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 441/900] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:38.742431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:38.742846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.742934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.743215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.743322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.743496 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.744282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.757461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:38.758941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:38.761088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:38.762308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:38.783820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:38.784860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:38.785759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:38.785759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:38.785759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:38.785759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:38.786491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 460/901] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:38.792715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:38.845894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 442/902] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:38.869344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:38.926137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051edd19-24c2-409e-853c-4ce3b9972dc1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:38.942235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:38.979144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:38.979820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:38.980103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:38.980379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:38.981121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:38.983735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:38.985124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:38.998331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 461/903] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:39.003335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.004027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffbf5c-5ac8-4834-899a-2e8b3d9c1dff None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.039096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.059647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.061112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.061894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.062448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.063713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.068586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:39.086135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:39.087224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:39.089311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 443/904] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:39.093743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.128833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c4be1-9330-4e48-be11-47e8bcc60a00 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.165836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.166856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.167241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.167659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.175171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.176778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:39.192830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:39.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:39.195304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:39.201927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 462/905] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:39.202901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.227437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aff88-c812-483a-8934-1a645a3a312d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.234383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.273110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.274252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.274703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.276124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.277274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:39.277751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.280534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.286648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 444/906] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:39.293926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.313597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e74fbd-38ac-42cb-8cfd-6f4379705c49 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.345674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.350457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.351179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.351413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.351688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.352521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:39.352840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.354598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.378198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 463/907] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:39.380780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.404872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11d3ef-f6d7-47de-a694-96d1fffe2198 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.443897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.444494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.444780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.445087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.445771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:39.446206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.447767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cad079-93fe-4cf1-93e0-70b0556c9183 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.455983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 445/908] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:39.455983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88772-fb4d-4900-993d-bad0ba639fb1 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.455983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88772-fb4d-4900-993d-bad0ba639fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.455983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e88772-fb4d-4900-993d-bad0ba639fb1 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.456870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 446/909] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:39.461467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e88772-fb4d-4900-993d-bad0ba639fb1 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.485159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.497981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd94da-6c1a-46b5-8ad4-e281998b87ed None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.535018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.535678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.535965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.536246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.572676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e88772-fb4d-4900-993d-bad0ba639fb1 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.585553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.608243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838353a-3fd2-4f29-9355-6880d0011c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.608874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838353a-3fd2-4f29-9355-6880d0011c2b None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.609165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838353a-3fd2-4f29-9355-6880d0011c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.609446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838353a-3fd2-4f29-9355-6880d0011c2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.610222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838353a-3fd2-4f29-9355-6880d0011c2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.611610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838353a-3fd2-4f29-9355-6880d0011c2b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.614317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.615845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.690052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 447/910] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:39.691898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.692199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.692521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.709403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.718294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:39.730997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:39.731162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 464/911] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:04:39.731891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.835234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 448/912] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:39.850838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3200df4-0c74-4e84-a177-7a6177ac477c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:39.861958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.892699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:39.893543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:39.893897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:39.894154 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:39.907878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:39.909765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:39.929902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:39.930916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:39.933636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:39.933636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:39.933636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:39.933636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:39.933636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 465/913] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:39.937351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:39.981451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:39.989443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc263bb-4502-43d0-aaba-0d13326ad11b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.004940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:40.033026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.034338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.034828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.035292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.036390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.038516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.083383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3686a5-dcf1-4c76-9711-ee61aa43a02a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.121269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.121969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.122253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.122527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.123420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:40.123726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.125125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.145891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 466/914] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:40.146567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 449/915] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:39 2022] POST /identity/v3/services => generated 241 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:40.148539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:40.268416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:40.272043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805db94-bff7-4b9e-8d7f-3a1af90010cc None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.316799 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.317618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.317949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.318229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.326219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.327801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-e901131f-833c-43f1-9bf2-a4193f6f6393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:40.342758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:40.343703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:40.344614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 467/916] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:40.350402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:40.416513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e593c-e497-4cf7-b963-e72ee3c6bb1b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.417118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e593c-e497-4cf7-b963-e72ee3c6bb1b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.417588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e593c-e497-4cf7-b963-e72ee3c6bb1b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.419449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 468/917] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:40.425482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.426317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.426605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.448840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:40.450386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:40.460061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1343b9f-b37e-474a-bd30-1a3f763c9090 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.497380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.498252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.498641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.499022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.500099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:40.500515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.502092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.515843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 450/918] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:40.522892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:40.537389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 469/919] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:40.542698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:40.561199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:40.657115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:40.659540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d4087-0c8a-4cca-bc68-00dcdbe7e498 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.672366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c030-1f99-4a81-a9d7-339f199a204c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.699778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.700773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.701224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.701702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.702783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] RBAC: Adding query filter params (role.id=e061d37653c04871bca908057dbb9ed3, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=f5270f6d342b4ec08c27b7d8de8a0a89) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:40.703264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.704998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.709524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.710489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.710775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.711052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.711707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.718030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.718239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 451/920] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:40 2022] GET /identity/v3/role_assignments?user.id=f5270f6d342b4ec08c27b7d8de8a0a89&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=e061d37653c04871bca908057dbb9ed3 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:40.735620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:40.736687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:40.737575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 470/921] 10.222.0.64 () {56 vars in 1132 bytes} [Mon Jun 20 12:04:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:40.744644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:40.830332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:40.853259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ff99b-8ea4-4d54-bb02-1dd8c2d67776 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:40.895333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:40.896011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:40.896295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:40.896574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:40.897294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:40.897602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:40.899024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:40.905930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 452/922] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:40.911752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:41.021348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a25bb-1426-4c76-ae2c-eb756e1bab1b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:41.057760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:41.058685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:41.059141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:41.059574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:41.060417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:41.060882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:41.062503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678236a0-a2cf-4b6c-8daf-ce1cf67520a7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:41.076443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 471/923] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:41.082524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:41.190899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbc9d7-61a8-4629-ac59-8f2518b9b089 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:41.227068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4e41c-8d92-4e54-9fa3-390dbf349f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:41.227728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e41c-8d92-4e54-9fa3-390dbf349f97 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:41.228055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e41c-8d92-4e54-9fa3-390dbf349f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:41.228946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e41c-8d92-4e54-9fa3-390dbf349f97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:41.229709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4e41c-8d92-4e54-9fa3-390dbf349f97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:41.231122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4e41c-8d92-4e54-9fa3-390dbf349f97 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:41.308974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:41.316043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 453/924] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:41.953680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede5133-ba18-463a-86c8-31a4ef242f70 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:41.954257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede5133-ba18-463a-86c8-31a4ef242f70 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:41.954563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede5133-ba18-463a-86c8-31a4ef242f70 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:41.956303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 472/925] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:41.961662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:41.962139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:41.963025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:41.980528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:41.981741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:42.058638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 454/926] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:42.083284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede5133-ba18-463a-86c8-31a4ef242f70 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:42.100270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:42.191659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede5133-ba18-463a-86c8-31a4ef242f70 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:42.232452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:42.233505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.234049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.234538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.235441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:42.237089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:42.238692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING keystone.server.flask.common [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 12:04:42.284923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.sql.core [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 12:04:42.284923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 12:04:42.284923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [parameters: {'id': '63413f5397dd49d9a789b64c0342322d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 12:04:42.284923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80465) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-8fc2971f-990b-4ce7-9add-27bf466be5dd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63413f5397dd49d9a789b64c0342322d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63413f5397dd49d9a789b64c0342322d. Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:04:42.302508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result.read() Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 12:04:42.303392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application yield resource Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise self.value Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application session.commit() Jun 20 12:04:42.304349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.session.flush() Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application compat.raise_( Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:04:42.305276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 12:04:42.306766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result.read() Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:04:42.309039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [parameters: {'id': '63413f5397dd49d9a789b64c0342322d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.311207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:42.313102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63413f5397dd49d9a789b64c0342322d. Jun 20 12:04:42.316981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.318486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 473/927] 10.222.0.64 () {60 vars in 1140 bytes} [Mon Jun 20 12:04:42 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:42.323228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:42.350445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566c84f-1387-4910-a490-728ec4a434d0 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.351130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566c84f-1387-4910-a490-728ec4a434d0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.351616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566c84f-1387-4910-a490-728ec4a434d0 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.356918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 474/928] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:42.362225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.362516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.362795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.383399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:42.385869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:42.427906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34673cc7-2762-4894-be36-fccc6bf35429 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:42.453672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:42.455086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:42.465169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:42.466056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 475/929] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:42.466271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.466688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.467098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.474262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:42.475966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:42.491342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:42.491569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:42.492446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:42.493351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 455/930] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:42.499636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:42.600183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e3354-ca58-421a-8ea1-492087843129 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:42.635959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f161d9-0857-4e77-bc23-d500c9c1cc30 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:42.637345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:42.638300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.638681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.639054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.639813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:42.641428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:42.655152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:42.656360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:42.657252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:42.661823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 476/931] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:42.662867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:42.675335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:42.676374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.676719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.677280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.678187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:42.678505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:42.680571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:42.705895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 456/932] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:42.736783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:42.781077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9a1b9-11d1-419e-989c-4b5e4ffe4659 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:42.818506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:42.819192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.819478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.819753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.820479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:42.820787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:42.822555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93a36-895c-4844-8178-ef3fd4cef004 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:42.828355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 477/933] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:42.834271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:42.895978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:42.919267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c61c6d-9618-4b6c-97f6-19f8ebfb63b6 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.919593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c61c6d-9618-4b6c-97f6-19f8ebfb63b6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.919769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c61c6d-9618-4b6c-97f6-19f8ebfb63b6 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.921415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 478/934] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:42.928578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:42.928578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:42.928578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:42.947608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:42.949112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:42.963870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc38e5-6f31-46c0-bead-1f92d3cd32a7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.010653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.011265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.011552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.011827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.012543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:43.012853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.014271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.024508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 457/935] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:43.030810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.037964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 479/936] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:43.063998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.136223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:43.161145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a4bdd-c565-4f20-b094-49a3d419e1eb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.176572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:43.198198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adc6f-c037-42ac-9181-f00bce192998 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.224049 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.225225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.225752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.227370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.228943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] RBAC: Adding query filter params (interface=public, service_id=5eb77ab073a64749957ac89564b3088c, region_id=RegionOne) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:43.229435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.231286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.236519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.237850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 458/937] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/endpoints?service_id=5eb77ab073a64749957ac89564b3088c&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:43.241853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.242286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.243099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.244285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.257338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:43.269449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:43.270497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:43.271351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:43.276646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 480/938] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:43.279027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.360634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1621b-d5f4-4bb5-ae31-e51874ec1a32 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.389826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef25d9-3640-4795-b6ea-d2592292cfd7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.396375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.397053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.397341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.397623 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.398341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.399914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.406864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 459/939] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:04:43.409252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:43.429714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.430643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.430643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.432846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.433656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:43.433993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.435490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e69a79-f92d-4b75-89bb-46342b020686 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.447823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 481/940] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:43.453407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.472294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaad30-e99d-410a-9263-a3b235afc87c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.472616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaad30-e99d-410a-9263-a3b235afc87c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.472866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaad30-e99d-410a-9263-a3b235afc87c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.475686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 482/941] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:43.480447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.480772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.481023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.496235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:43.506789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:43.508636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:43.571279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26a4d4-2021-477a-b28d-8083f14bbfab None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.595486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 483/942] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:43.617173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.618078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.618391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.619633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.620179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.633614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.636304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:43.659059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:43.660045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:43.660944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:43.660944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:43.660944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:43.660944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:43.665822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 460/943] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:43.667584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.739714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07872c12-3da1-4757-9e9d-54b8d9bf3d3c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.751669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:43.773004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:43.778446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117553-ab82-4b96-b609-0b050785885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.779691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117553-ab82-4b96-b609-0b050785885b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.780155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117553-ab82-4b96-b609-0b050785885b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.780586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117553-ab82-4b96-b609-0b050785885b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.781387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117553-ab82-4b96-b609-0b050785885b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.782971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117553-ab82-4b96-b609-0b050785885b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.786363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f092-0074-4f60-979f-4347a35c7419 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-90117553-ab82-4b96-b609-0b050785885b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:43.796797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:43.798059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:43.798940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:43.801783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 484/944] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:43.810503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117553-ab82-4b96-b609-0b050785885b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.825755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.826473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.826762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.827045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.827772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:43.828223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.830165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.843778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 461/945] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:43.849038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:43.933907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117553-ab82-4b96-b609-0b050785885b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.972695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:43.973396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:43.973686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:43.974001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:43.974119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73e140-03fb-4436-b68e-be7272fe3d08 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:43.974720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:43.975036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:43.977463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:43.983307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 485/946] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:43.991089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.024550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.025906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.026485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.027055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.035994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.037711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.039622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:44.054769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:44.057710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:44.058709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:44.060606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 462/947] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:44.067025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.084947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:44.120235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17222-fe4d-4c79-bdcf-b2578dbd8ba3 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:44.167178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.168822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.169304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.169766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.170843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:44.171767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.173970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.186638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 486/948] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:44.200637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ecd99-740c-4fca-90bc-6f177dc1a3cc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:44.240100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.240784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.241066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.241342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.242281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:44.242591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.244176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.270105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 463/949] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jun 20 12:04:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:44.271700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.383531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199fda7-9fd7-4052-92e9-4e6055c909eb None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:44.386189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:44.420525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.421370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.421659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.422000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.434473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.435931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:44.453987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:44.454929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:44.455838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:44.455838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:44.455838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:44.455838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:44.455838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 487/950] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:44.461195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.531374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:44.570363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c4d31-a6ad-416c-881a-ed6e211d64f1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:44.610598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.611655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.612150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.612634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.613562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:44.614102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.615712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.629207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 464/951] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:44.634931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.741217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37220561-4412-4233-80b2-fb7cd9793fa6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:44.776831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.777629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.777976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.778252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.785317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.786933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-61bbe0f4-59d3-4a51-87b2-3fa158f975e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:44.801313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:44.802333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:44.803315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 488/952] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:44.809412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.916654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85287-d159-4038-870d-9a44b67f8802 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:44.944440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:44.954430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:44.965698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.965698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.965698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.965698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:44.965698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:44.965698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:44.966165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777a3c-5987-4944-8e06-399f5c24695b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.966165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777a3c-5987-4944-8e06-399f5c24695b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.966165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54777a3c-5987-4944-8e06-399f5c24695b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.966165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 489/953] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:44.969202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:44.969499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:44.969755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:44.974352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 465/954] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:44.981007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:44.989832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:44.991062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:45.005989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:45.078391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 490/955] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:45.096370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:45.122153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0a6e9-4a00-4003-ab7b-aa5a4a5275c3 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:45.158313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:45.159214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.159501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.159781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/f5270f6d342b4ec08c27b7d8de8a0a89/roles/e061d37653c04871bca908057dbb9ed3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.162100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=f5270f6d342b4ec08c27b7d8de8a0a89, role_id=e061d37653c04871bca908057dbb9ed3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:45.163553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:45.207115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5941911-eb9b-4aab-a645-ff0b4ff19914 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:45.244506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:45.245178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.245454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.245738 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.246467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:45.247902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:45.271101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 466/956] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:04:44 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/f5270f6d342b4ec08c27b7d8de8a0a89/roles/e061d37653c04871bca908057dbb9ed3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:04:45.296899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.sql.core [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 12:04:45.296899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 12:04:45.296899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [parameters: {'user_id': 'fd07c0199de4474e8e56a291ea0cc7df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 12:04:45.296899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80465) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result.read() Jun 20 12:04:45.304959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:04:45.306159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application yield resource Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application next(self.gen) Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise self.value Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application session.commit() Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 12:04:45.307297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.session.flush() Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application compat.raise_( Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 12:04:45.308950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 12:04:45.309965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application conn.query(q) Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application result.read() Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 12:04:45.310865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fd07c0199de4474e8e56a291ea0cc7df', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:45.312491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 12:04:45.314666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:45.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 491/957] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jun 20 12:04:45 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:45.318088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:45.379505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:45.446237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20834f95-ba8e-4d8c-a41b-f85327fd8b0c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:45.489995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:45.490856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.491143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.491419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.499877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:45.501338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-64eb51ec-a75c-4169-978d-98bdff23fb15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:45.516567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:45.517567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:45.518584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 467/958] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:04:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:45.523819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:45.535120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:45.536336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb25d-d213-4bc5-b999-bf7c324f59fe None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.536620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb25d-d213-4bc5-b999-bf7c324f59fe None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.536897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82eb25d-d213-4bc5-b999-bf7c324f59fe None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.538538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 468/959] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:45.543939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.544290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.554025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.562629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:45.563857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:45.636300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df268c3-d353-4cfc-8e82-613a6360560c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:45.640517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 469/960] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:45.663231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:45.672844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:45.673528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.673917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.674216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.675079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:45.675393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:45.677042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:45.699093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:45.723803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 492/961] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jun 20 12:04:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:45.773258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeadca9-c748-42e3-8b87-566c1d962940 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:45.814006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:45.815175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:45.815636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:45.816112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:45.816936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:45.818570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:45.832726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:45.834144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:45.835249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:45.839059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 470/962] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:45.847024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:45.918777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:45.959733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bcb6-d5be-4285-bb6b-6ad0bbd0acb0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:45.999219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:45.999894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:46.000181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:46.000458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:46.001172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:46.001484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:46.002902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:46.008422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 493/963] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:46.014601 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:46.121071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:46.124211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57451a75-513c-4b5e-8c45-36a4fab7cb6c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:46.159054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:46.159719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:46.159999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:46.160273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:46.160982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:46.161439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:46.162848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7d41f-3246-4654-8cba-d54812691491 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:46.172987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 471/964] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:46.174573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:46.279154 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824baa24-5e73-434e-85bc-e220f703265c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:46.305127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:46.313812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b137c2-5028-4a9b-9897-de11f32a5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:46.314523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b137c2-5028-4a9b-9897-de11f32a5417 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:46.314810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b137c2-5028-4a9b-9897-de11f32a5417 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:46.315074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b137c2-5028-4a9b-9897-de11f32a5417 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:46.315810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b137c2-5028-4a9b-9897-de11f32a5417 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:46.317186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b137c2-5028-4a9b-9897-de11f32a5417 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:46.400756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 494/965] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:46.479696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa4ef-5e7f-4c1d-aa0c-6ed0fba13f5c None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:46.480048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa4ef-5e7f-4c1d-aa0c-6ed0fba13f5c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:46.480281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aa4ef-5e7f-4c1d-aa0c-6ed0fba13f5c None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:46.482030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 472/966] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:46.488179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dfa06-9b87-4b48-9dd6-e35b5161d191 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:46.488873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dfa06-9b87-4b48-9dd6-e35b5161d191 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:46.489375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dfa06-9b87-4b48-9dd6-e35b5161d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:46.508455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-414dfa06-9b87-4b48-9dd6-e35b5161d191 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:46.511098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-414dfa06-9b87-4b48-9dd6-e35b5161d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:46.594465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 495/967] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:46.617298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa4ef-5e7f-4c1d-aa0c-6ed0fba13f5c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:46.724076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aa4ef-5e7f-4c1d-aa0c-6ed0fba13f5c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:46.757679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925b5d9-8968-4641-96df-8a46f8d86655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:46.758375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b5d9-8968-4641-96df-8a46f8d86655 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:46.758665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b5d9-8968-4641-96df-8a46f8d86655 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:46.759034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925b5d9-8968-4641-96df-8a46f8d86655 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:46.760325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b5d9-8968-4641-96df-8a46f8d86655 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:46.761795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925b5d9-8968-4641-96df-8a46f8d86655 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:46.841848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 473/968] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:46 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:47.456409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f8a50-48c8-4b3e-b322-209b5b5faede None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:47.456907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f8a50-48c8-4b3e-b322-209b5b5faede None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:47.456907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f8a50-48c8-4b3e-b322-209b5b5faede None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:47.458354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 496/969] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:47.464491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:47.464894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:47.465086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:47.481771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:47.482990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:47.501118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:47.559496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 474/970] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:47.584349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f8a50-48c8-4b3e-b322-209b5b5faede None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:47.689560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f8a50-48c8-4b3e-b322-209b5b5faede None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:47.701597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:47.726284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:47.727298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:47.727585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:47.728567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:47.738774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:47.747660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:47.748821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:47.749770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:47.752602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 497/971] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jun 20 12:04:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:47.758282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:47.858618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacf8a1-fa66-4e33-8487-c1f763db5263 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:47.892434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:47.893100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:47.893386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:47.893665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:47.894440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:47.894751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:47.896134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:47.905146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 475/972] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:04:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:47.910504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.018199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17706dd-f6b2-4a6b-bc0a-684722646792 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.054564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:48.055359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.055644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.056183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.072592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:48.073989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:48.092867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:48.093857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:48.094800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:48.094800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:48.094800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:48.094800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:48.094800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 498/973] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:48.099677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.115655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:48.203368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bddff-9e6a-4fb7-8543-d99f57ace648 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.236891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:48.237557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.237867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.238149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.238870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:48.239181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:48.240554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:48.253093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 476/974] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:48.258451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.284852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:48.361968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116f21f-72a2-4f94-a97f-b3c38509c0c5 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.397434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:48.398285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.398570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.398846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.406752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:48.408204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-e8d745bf-6c30-4e63-aa72-4ff92f3fe5af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:48.423055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:48.424032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 12:04:48.425036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:48.429054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 499/975] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:48.430378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.503719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:48.535001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57af15a-7544-4fa5-9c8d-fed62b774f94 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.544581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc531-a8b0-4e1f-b7b5-6e60c25ac0f3 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.545082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc531-a8b0-4e1f-b7b5-6e60c25ac0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.545188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffc531-a8b0-4e1f-b7b5-6e60c25ac0f3 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.546868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 500/976] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:48.551870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.552155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.552432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.569401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:48.570616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:48.573471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:48.574198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.574488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.574772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.575622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:48.575940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:48.577385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:48.597310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 477/977] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:48.604097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.645359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 501/978] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:48.669739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.684828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:48.720590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d24715-11b7-4773-8dda-81418f7cd62a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.751492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:48.757320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d54f72-8df5-4d9a-8d3d-3ce54aac187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:48.758006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d54f72-8df5-4d9a-8d3d-3ce54aac187d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.758288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d54f72-8df5-4d9a-8d3d-3ce54aac187d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.758560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d54f72-8df5-4d9a-8d3d-3ce54aac187d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.795196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc559f-be7f-470f-841d-d2e4be2507bb None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.832463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:48.833272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.833941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.833941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.834501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:48.835875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:48.836149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d54f72-8df5-4d9a-8d3d-3ce54aac187d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:48.838551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d54f72-8df5-4d9a-8d3d-3ce54aac187d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:48.848933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:48.850030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:48.850933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 502/979] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:48.856478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.947694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 478/980] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:04:48.947694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9730e0-2fb1-4d48-8d04-b3e69820cac1 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:48.947694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9730e0-2fb1-4d48-8d04-b3e69820cac1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:48.947694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9730e0-2fb1-4d48-8d04-b3e69820cac1 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:48.947694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 479/981] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:48.948683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9730e0-2fb1-4d48-8d04-b3e69820cac1 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:48.951046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:48.973204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a2ab0-8c03-429a-9e76-e1aa67d0d327 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:48.978515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.007339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.008003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.008285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.008570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.010313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.010626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.012003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5397aa-0859-493c-b3ad-3003578ba71d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.016770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 503/982] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:49.017975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.018268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.018550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.036107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:49.037283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:49.050879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9730e0-2fb1-4d48-8d04-b3e69820cac1 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.088930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.089726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.090051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.090328 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.100244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.101696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.105234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 504/983] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:49.106190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:49.123549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:49.124497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:49.125437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:49.125437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:49.125437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:49.125437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:49.125437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 480/984] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:49.130399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.179700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.211007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.211215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b407d6-4f55-4d98-afb6-b72e9874e289 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.229961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9df3f-c648-46d4-97e6-779601641f4d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.245906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.246572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.246858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.247134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.247833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.248142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.249507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.254299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 505/985] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.255069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.265491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.266323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.266609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.266888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.267537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.268907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:49.281305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:49.282424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:49.283409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 481/986] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:49.285445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.356405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959af0b3-81a2-4499-a23b-992072d4290a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.392643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.393297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.393576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.393878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.394722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.395164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.396278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e78f51-9806-4d44-9d7a-b473d044d60e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.396664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.398209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.410378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 506/987] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.411188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.433438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.434134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.434420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.434702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.435499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] RBAC: Adding query filter params (interface=admin, service_id=5eb77ab073a64749957ac89564b3088c, region_id=RegionOne) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.435815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.437189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.447555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 482/988] 10.222.0.64 () {56 vars in 1249 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/endpoints?service_id=5eb77ab073a64749957ac89564b3088c&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.447555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.459155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.512266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f089e3-1312-42a6-9e7c-26ed9538edd7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.546062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.546712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.546997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.547271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.547971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.548277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.549505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce0bb7-5b44-4f95-b725-a43a2d9e85c0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.549917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.554516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 507/989] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.555071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.586660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.587805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.588090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.588372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.595115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.596569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:49.611224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:49.612095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 483/990] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:49.613465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.619564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.662199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868596-8ed2-4979-bfca-076fcc7d9593 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.684153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.698846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.699588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.699881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.700192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.700875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.702301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.709556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 508/991] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:04:49.710513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.715880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d460-22e0-4996-b323-5415753ca70f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.762380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.763103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.763363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.763646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.764378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] RBAC: Adding query filter params (type=compute) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.764696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.766165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.772088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 484/992] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.778710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.833940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9f68-897f-4820-9c05-f11860f01353 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.860257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.873649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.873649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.873649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.873649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.874053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.874339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.875706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.890748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 509/993] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.896271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:49.896813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb7b20-58fe-49d7-b343-70dce0f842ca None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:49.933676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:49.934395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:49.934683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:49.934961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:49.935753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] RBAC: Adding query filter params (interface=public, service_id=7920b544b5c44c2c95cbe3129b61ca9a, region_id=RegionOne) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:49.936071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:49.937455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:49.939147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:49.948828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 485/994] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/endpoints?service_id=7920b544b5c44c2c95cbe3129b61ca9a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:49.950276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:50.010367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c8ed9-0e1a-4ee7-8107-33f2e8ef7d1f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:50.051867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:50.052541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:50.052855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:50.053162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:50.054034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] RBAC: Adding query filter params (role.id=e061d37653c04871bca908057dbb9ed3, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=f5270f6d342b4ec08c27b7d8de8a0a89) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:50.054357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:50.056772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387161-3ec1-47cb-a73e-b6a0b8bea11d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:50.061074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726ac85-f48f-4cfb-814d-b814db582942 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:50.063364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 510/995] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/role_assignments?user.id=f5270f6d342b4ec08c27b7d8de8a0a89&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=e061d37653c04871bca908057dbb9ed3 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:50.104789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d07bd-2992-414d-ad8d-118392cd87ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:50.105575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d07bd-2992-414d-ad8d-118392cd87ab None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:50.105924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d07bd-2992-414d-ad8d-118392cd87ab None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:50.106207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d07bd-2992-414d-ad8d-118392cd87ab None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:50.106903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d07bd-2992-414d-ad8d-118392cd87ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:50.108367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d07bd-2992-414d-ad8d-118392cd87ab None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:50.115706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 486/996] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:49 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:04:51.781125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd047-3f8f-42fb-85c0-6b9e858b7e6f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:51.781677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd047-3f8f-42fb-85c0-6b9e858b7e6f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:51.781772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd047-3f8f-42fb-85c0-6b9e858b7e6f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:51.783306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 511/997] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:51.788499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:51.788893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:51.789053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:51.806962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:51.808153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:51.867687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:51.878735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 487/998] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:51.901614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd047-3f8f-42fb-85c0-6b9e858b7e6f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:51.953649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.008245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd047-3f8f-42fb-85c0-6b9e858b7e6f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.045002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.045833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.046118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.046392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.047052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.048421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1e4fa28d-2e8d-4985-8000-0f52d968b8d1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:52.060906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:52.061956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 12:04:52.062817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.068723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 512/999] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jun 20 12:04:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:52.068855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.170895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43afff-d79a-4bf0-92e9-14261b8d6100 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.178098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4728c1c-0934-40e4-bec8-06122a9190bd None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.178395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4728c1c-0934-40e4-bec8-06122a9190bd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.178674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4728c1c-0934-40e4-bec8-06122a9190bd None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.180044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 513/1000] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:52.185735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ba10-bb47-4975-8ccb-10a7cd6f3c0c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.186116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ba10-bb47-4975-8ccb-10a7cd6f3c0c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.186391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6ba10-bb47-4975-8ccb-10a7cd6f3c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.204597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-58f6ba10-bb47-4975-8ccb-10a7cd6f3c0c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:52.205774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-58f6ba10-bb47-4975-8ccb-10a7cd6f3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:52.207453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.208287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.209332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.209618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.210370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:52.210684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.212592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3f28f-7677-4ffe-8686-a5b85f872d8c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.217612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 488/1001] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:52.219006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c063a4-5327-41d2-a8f3-d5e6d75aa464 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.219304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c063a4-5327-41d2-a8f3-d5e6d75aa464 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.219586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c063a4-5327-41d2-a8f3-d5e6d75aa464 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.220819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 489/1002] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:52.223180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c063a4-5327-41d2-a8f3-d5e6d75aa464 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.276704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 514/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:52.278106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.278399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.278683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.287569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.296001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:52.297174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:52.332055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.332676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c063a4-5327-41d2-a8f3-d5e6d75aa464 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.365939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 515/1004] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:52.366853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.366985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.367623 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.367903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.368296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.369638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:52.369981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.371367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.376447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 490/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:52.382126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.471394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccd6af-2247-44fb-903f-12d5b18d61c9 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.485158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668862f-15d6-4c16-8af4-9d10b36e9edc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.506212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.506375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.507027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.507304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.507572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] PATH_INFO: `/v3/services/image` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.508213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.510140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.520371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.524368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.524368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:52.524534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:52.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:04:52.526464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.527260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.527260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.527389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 516/1006] 10.222.0.64 () {56 vars in 1105 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:52.527389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.527526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.559281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.622820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eabc15-30c0-4753-b36f-75ce8c523e37 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.639746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 491/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:52.640704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.673577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.674430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.674722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.675023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.675674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.677109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:52.690529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:52.691672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 12:04:52.692590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:52.695655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 517/1008] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:52.699000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.771992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561859e-31f7-465f-92c7-a8eddf4d5203 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.806791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.814836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.815275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc28ea7-c1ae-4592-94ac-299c4a28ac8a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.815451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.815742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.816028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.816746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] RBAC: Adding query filter params (name=image) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:52.817060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.818548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.827271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 492/1009] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:52.833020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.853135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.853941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.854235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.854516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.855228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] RBAC: Adding query filter params (name=compute) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:52.855542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.856926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.862599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 518/1010] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:52.867916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:52.887429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:52.945429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234bdc5-d645-4ddf-b08c-0ce1d691a22f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.974104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0a0be-fe29-4cdd-b4f5-f8e1855a3bde None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:52.981054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:52.982096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:52.982524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:52.982944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:52.983909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] RBAC: Adding query filter params (type=image) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:52.984278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:52.985815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:52.997838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 493/1011] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:53.019833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:53.020648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:53.021010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:53.021364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:53.022218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:53.022603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:53.024110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46580ce7-7e73-44a6-b112-680bbc27c550 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:53.040153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 519/1012] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jun 20 12:04:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:53.046879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:53.168068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72550dd6-d333-4b51-8dba-ef05e38b5079 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:53.178026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:53.206289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdab8f-2632-434f-8411-e530bdbd2ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:53.206961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdab8f-2632-434f-8411-e530bdbd2ff8 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:53.207248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdab8f-2632-434f-8411-e530bdbd2ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:53.207528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdab8f-2632-434f-8411-e530bdbd2ff8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:53.208278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdab8f-2632-434f-8411-e530bdbd2ff8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:53.209700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fdab8f-2632-434f-8411-e530bdbd2ff8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:53.314674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 494/1013] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:04:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:54.732499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0cf0-728e-4aa9-a836-2fc48d6f4be4 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:54.733053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0cf0-728e-4aa9-a836-2fc48d6f4be4 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:54.733053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f0cf0-728e-4aa9-a836-2fc48d6f4be4 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:54.734617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 520/1014] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:54.739712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:54.740157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:54.740338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:54.758031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:54.759827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:54.833738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 495/1015] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:54.858283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0cf0-728e-4aa9-a836-2fc48d6f4be4 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:54.884829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:54.966277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f0cf0-728e-4aa9-a836-2fc48d6f4be4 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:55.000545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76770a8-3bc7-42d3-818e-b60c0e1019a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:55.001266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76770a8-3bc7-42d3-818e-b60c0e1019a2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.001551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76770a8-3bc7-42d3-818e-b60c0e1019a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.001845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76770a8-3bc7-42d3-818e-b60c0e1019a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.003027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76770a8-3bc7-42d3-818e-b60c0e1019a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:55.004468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76770a8-3bc7-42d3-818e-b60c0e1019a2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:55.006293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 521/1016] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:55.012080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:55.069707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0cd09-fb5a-4540-893f-4321d05f3447 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.070063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0cd09-fb5a-4540-893f-4321d05f3447 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.070300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0cd09-fb5a-4540-893f-4321d05f3447 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.072035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 522/1017] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:04:55.077062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.077347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.077621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.094833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:55.096013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:55.120218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:55.130382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b1bb8-d098-439c-8849-06f7a15c2533 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:55.169117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 523/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:55.170620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bb6a9-39c2-4437-9b95-49072deb9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:55.171515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb6a9-39c2-4437-9b95-49072deb9568 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.171975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb6a9-39c2-4437-9b95-49072deb9568 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.172430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb6a9-39c2-4437-9b95-49072deb9568 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.173325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bb6a9-39c2-4437-9b95-49072deb9568 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:55.174979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bb6a9-39c2-4437-9b95-49072deb9568 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:55.191721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:55.213671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:55.240167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 496/1019] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:55 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:04:55.300147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8af5-e68f-4071-998b-7ea958d24714 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:55.340905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5987ec-8cc4-4a87-820c-9dfd5fb1d7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:55.341587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5987ec-8cc4-4a87-820c-9dfd5fb1d7fa None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.341899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5987ec-8cc4-4a87-820c-9dfd5fb1d7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.342176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5987ec-8cc4-4a87-820c-9dfd5fb1d7fa None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.342964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5987ec-8cc4-4a87-820c-9dfd5fb1d7fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:55.344360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5987ec-8cc4-4a87-820c-9dfd5fb1d7fa None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:55.446366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 524/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:04:55 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:04:55.469106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebb812-f408-4726-8c13-f246b8cc4714 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.469394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebb812-f408-4726-8c13-f246b8cc4714 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.469885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebb812-f408-4726-8c13-f246b8cc4714 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.471510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 497/1021] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:55.477251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.478681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.478681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.496251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:55.497486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:55.582345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 525/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:55.606482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebb812-f408-4726-8c13-f246b8cc4714 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:55.716857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebb812-f408-4726-8c13-f246b8cc4714 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:55.751205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:55.752024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.752309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.752591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.763595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:04:55.771987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:55.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:55.773884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 498/1023] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jun 20 12:04:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:55.782118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:55.791550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:55.884536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a8917-6900-4d4e-8224-1e7eb4eab99f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:55.919080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:55.919748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:55.920027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:55.920301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:55.921053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:55.921343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:55.922742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:55.934156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 526/1024] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:04:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:55.937721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:55.941920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:56.043932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c7be-03c1-4ae7-9900-3c7f444429f1 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:56.084164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:56.084970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:56.085269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:56.085536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:56.096161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:56.097625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:56.115726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:56.116632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:56.123015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:56.123015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:56.123015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:56.123015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:56.123015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 499/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:56.123308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:56.194198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:56.229606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e39e55-c996-44b2-b70c-be8085885f0f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:56.263029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:56.263693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:56.263980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:56.264257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:56.264978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:56.265287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:56.266687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:56.279225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 527/1026] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:56.284821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:56.339859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:56.387205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804460-69da-456d-a9e7-579d6d10caef None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:56.423783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:56.424585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:56.424867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:56.425139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:56.433878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:56.435361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:04:56.449897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:56.450898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:04:56.451878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 500/1027] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:04:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:56.459081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:56.562686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d549-0f8d-45b3-bad0-c6221689d91d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:56.590530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:56.599503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:56.600181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:56.600466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:56.600740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:56.601585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:56.601970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:56.603681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:56.621699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 528/1028] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:04:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:56.627356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:56.726989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03edb-f44a-45c9-99b1-ad721ffaa445 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:56.740314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:56.761028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:56.761674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:56.761988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:56.762269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:56.829777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:56.831285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:56.934190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 501/1029] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:04:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:04:56.935626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.036526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568dccf-94b0-4efa-81ba-8eb291e36636 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.078017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.078017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.078017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.078017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.090752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.092217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:04:57.110002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:57.110941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:57.116365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:04:57.116365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:04:57.116365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:04:57.116365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:57.116365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 529/1030] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:04:57.117023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.132159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:57.219518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b958e57-06b5-4f2c-a561-1c43a1ef3e35 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.254396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.255068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.255354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.255634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.256357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:57.256668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.258079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a172180-183f-4233-bea6-7d12be3bf551 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.273862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 502/1031] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:57.275742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.317923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:57.360612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaca61-b14e-4dd0-b3e7-8af299930248 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.360913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaca61-b14e-4dd0-b3e7-8af299930248 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.361195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eaca61-b14e-4dd0-b3e7-8af299930248 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.362727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 503/1032] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:57.367335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.367624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.368507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.380949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef710a-6533-4aa2-bad4-a50cb99fbee7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.386126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:57.387416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:57.419611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.420405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.420695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.421155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.427984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.429550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:04:57.444041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:57.444988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:57.446301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 530/1033] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:57.451078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.462773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 504/1034] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:04:57.487220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.491864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:57.559049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:57.562875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f523153-8f5b-434a-9957-905e078d8702 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.594039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17d97b-39c4-45ba-8aa1-d6353d607ece None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.597257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.597940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.598229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.598505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.599288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:57.599599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.601031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962c5e9-7add-4c10-acc5-a3766534af75 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.614486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 531/1035] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:57.615891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1766741-3efe-4964-9a13-bd3367a2eb5c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.616192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1766741-3efe-4964-9a13-bd3367a2eb5c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.616475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1766741-3efe-4964-9a13-bd3367a2eb5c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.617720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 532/1036] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:57.622965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1766741-3efe-4964-9a13-bd3367a2eb5c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.631024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e3d0d-dd39-447a-b4c5-f99eab4c4f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.631828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3d0d-dd39-447a-b4c5-f99eab4c4f14 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.632110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3d0d-dd39-447a-b4c5-f99eab4c4f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.632385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e3d0d-dd39-447a-b4c5-f99eab4c4f14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.634114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e3d0d-dd39-447a-b4c5-f99eab4c4f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.635564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e3d0d-dd39-447a-b4c5-f99eab4c4f14 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.637177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 505/1037] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:57.638381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.638665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.638943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.655575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:57.656786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:57.723288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 506/1038] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:57.724186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.726413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:57.731111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1766741-3efe-4964-9a13-bd3367a2eb5c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.765645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.766325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.766604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.766875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.767691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] RBAC: Adding query filter params (role.id=e061d37653c04871bca908057dbb9ed3, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=75c9161930b64f0e910a4a3323fa733a) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:57.768001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.769409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.775207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 533/1039] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/role_assignments?user.id=75c9161930b64f0e910a4a3323fa733a&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=e061d37653c04871bca908057dbb9ed3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:57.775984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:57.803817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:57.855776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924b28-452c-4306-86d8-50c19342b380 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.891543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973163-c6ee-43b2-a912-3abf599df034 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:57.894135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.894833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.895120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.895400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.896138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.897616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.932971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:57.933765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:57.934081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:57.934432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:57.935093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:57.936464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:04:57.949142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:04:57.952151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:04:57.953023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 534/1040] 10.222.0.64 () {56 vars in 1105 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:04:57.956298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:58.007028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 507/1041] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:04:57 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:04:58.053776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:58.075305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736b98-f6c7-44df-a120-2492777d7aa9 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:58.116454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:58.117055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:58.117344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:58.117626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:58.118447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] RBAC: Adding query filter params (name=image) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:58.118760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:58.120176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:58.126289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 535/1042] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:04:58.131965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:58.198241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:58.241658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3739265-53fb-4ef0-9468-5f213a96950b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:58.280783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:58.281770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:58.282292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:58.282752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:58.283658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] RBAC: Adding query filter params (type=image) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:58.284159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:58.285713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:58.291194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 508/1043] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:04:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:58.297156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:58.398575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933df6d-d53b-45ec-89eb-0b3010c3f91e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:58.433709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:58.434495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:58.434786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:58.435064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:58.435850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] RBAC: Adding query filter params (interface=public, service_id=3b6e49a78cd940e589a4571ba2c08f4a, region_id=RegionOne) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:04:58.436169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:58.437544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f855-611b-4b71-b5a5-61cd48b1f681 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:58.447374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 536/1044] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:04:58 2022] GET /identity/v3/endpoints?service_id=3b6e49a78cd940e589a4571ba2c08f4a&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:04:58.448972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:58.550615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920eda63-ff2b-4115-8d26-96f9ff874b98 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:04:58.575058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:04:58.586702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04fff3-20a2-42dd-96d1-38d86a2c9d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:04:58.587496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04fff3-20a2-42dd-96d1-38d86a2c9d86 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:58.592010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04fff3-20a2-42dd-96d1-38d86a2c9d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:58.592010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04fff3-20a2-42dd-96d1-38d86a2c9d86 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:58.592010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04fff3-20a2-42dd-96d1-38d86a2c9d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:04:58.592010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04fff3-20a2-42dd-96d1-38d86a2c9d86 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:04:58.605893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 509/1045] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:04:58 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:04:59.837146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b0cc2-f5b3-4cce-8f10-160cd3f03ba1 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:59.837745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b0cc2-f5b3-4cce-8f10-160cd3f03ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:59.837745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b0cc2-f5b3-4cce-8f10-160cd3f03ba1 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:59.839264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 537/1046] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:04:59.844397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:04:59.844798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:04:59.844995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:04:59.862397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:04:59.863579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:04:59.930271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 510/1047] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:04:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:04:59.953210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b0cc2-f5b3-4cce-8f10-160cd3f03ba1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:04:59.969761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.057171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b0cc2-f5b3-4cce-8f10-160cd3f03ba1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.097254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e324c58-5cd3-4a9c-b28d-d3a7c3775fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.098015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324c58-5cd3-4a9c-b28d-d3a7c3775fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.098301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324c58-5cd3-4a9c-b28d-d3a7c3775fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.098575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e324c58-5cd3-4a9c-b28d-d3a7c3775fc3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.110866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e324c58-5cd3-4a9c-b28d-d3a7c3775fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-8e324c58-5cd3-4a9c-b28d-d3a7c3775fc3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:00.119809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:00.120795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:00.121644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 538/1048] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jun 20 12:04:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:00.128557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.161141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d86cdf-641d-405c-9989-c1efd6e84c0c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.161437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d86cdf-641d-405c-9989-c1efd6e84c0c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.161719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d86cdf-641d-405c-9989-c1efd6e84c0c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.164398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 539/1049] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:05:00.169429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.170344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.170633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.194713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:00.195930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:00.234792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8dfadf-e234-41fa-a73b-f33d390ec43c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.253622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.271109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618837-be87-4550-8d28-45e23c63823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.271787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618837-be87-4550-8d28-45e23c63823b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.272078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618837-be87-4550-8d28-45e23c63823b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.272344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618837-be87-4550-8d28-45e23c63823b None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.273094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618837-be87-4550-8d28-45e23c63823b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:00.273407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618837-be87-4550-8d28-45e23c63823b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:00.275507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618837-be87-4550-8d28-45e23c63823b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:00.275669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 540/1050] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:05:00.285835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 511/1051] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:00.289509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.295817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.299903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618837-be87-4550-8d28-45e23c63823b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.397845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d581a-a709-48a2-ac02-3c41473ad175 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.405791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618837-be87-4550-8d28-45e23c63823b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.437573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.438392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.438677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.438954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.440692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.441477 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.441762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.442066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.449647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:00.451137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:00.452809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:00.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:00.461365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:00.462772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:00.467433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 512/1052] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:05:00.468089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:05:00.472268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:00.473125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:00.474082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:05:00.474082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:05:00.474082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:00.474082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:00.474082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 541/1053] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:05:00.479310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.517606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.538441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.582337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3e4cf-e263-42aa-94f6-373fa5dc2475 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.583510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa248b23-5e12-4cf8-bfe4-264c292e84c0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.619431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.620373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.620816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.621096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.621840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:00.622154 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:00.622409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.623073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.623352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.623531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:00.623636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.624346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:00.624651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:00.626675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:00.640475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 542/1054] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:00.640679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 513/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:00.642659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.642806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.745914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa6aa1-876a-416a-b58c-154053d13484 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.746572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.749600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53f0de-daa0-446d-a2bb-99cd53008e36 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.763065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.781464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.782292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.782579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.782856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.784209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178d9e2-922a-448b-8f76-c5db36db5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.785078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178d9e2-922a-448b-8f76-c5db36db5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.785363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178d9e2-922a-448b-8f76-c5db36db5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.785633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178d9e2-922a-448b-8f76-c5db36db5da2 None admin] PATH_INFO: `/v3/users/362f45afe36f4ae2a1b45871a3db10bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.790535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:00.791994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:00.798835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178d9e2-922a-448b-8f76-c5db36db5da2 None admin] RBAC: Authorizing `identity:get_user(user_id=362f45afe36f4ae2a1b45871a3db10bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:00.800271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178d9e2-922a-448b-8f76-c5db36db5da2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:00.802286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 514/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/users/362f45afe36f4ae2a1b45871a3db10bb => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:00.803447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e023-9a0b-40c1-90ab-25d70c11edab None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.803733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e023-9a0b-40c1-90ab-25d70c11edab None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.804010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57e023-9a0b-40c1-90ab-25d70c11edab None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.805380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 515/1057] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-7dfdff09-5d7e-4796-8a84-af43c18d3c5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:05:00.806114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:00.807096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:00.808075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 543/1058] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:05:00.809905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e023-9a0b-40c1-90ab-25d70c11edab None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.810919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.811210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.811491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.829551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:00.830765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:00.896440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 544/1059] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:05:00.897276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:00.917898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57e023-9a0b-40c1-90ab-25d70c11edab None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:00.953507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:00.954177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:00.954462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:00.954740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:00.981313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:00.998584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f335e-a920-4ff2-8178-5a3a156297cd None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.005657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.020058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.021519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.032199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.032861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.033144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.033420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.034277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:01.034610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.036003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.052930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 545/1060] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:01.053736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.129948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 516/1061] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:05:01.130799 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.156964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1dcea-d12d-4383-a5a1-b39f33e20200 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.187883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.191378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.192170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.192515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.192793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] PATH_INFO: `/v3/services/image` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.193444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.194917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:01.207214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:01.208343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:01.209351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 546/1062] 10.222.0.64 () {56 vars in 1105 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:01.210244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.235530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978dc7f-a5cc-4130-bf01-00a65fd7cfba None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.238983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.269727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.270557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.270853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.271136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.282102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.283551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:05:01.301606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:01.302740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:01.303699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:05:01.303699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:05:01.303699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:01.303699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:01.303699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 517/1063] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:01.303699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.318440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194112d-5d3e-4217-b3cf-fa0b4a6299dd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.351288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.352674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.352957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.353237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.354431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] RBAC: Authorizing `identity:get_project(project_id=8b57b7432caa49c8a9fa01b86fa0885b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.355877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.357729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 547/1064] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:01.358436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.407509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe94acf-91b9-40e8-be79-19d16a05c9e7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.418624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.441989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.442657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.443001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.443479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.444359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:01.444948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.447028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.451980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.452275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 518/1065] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:01.452769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.462694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1946-12e8-4718-97a6-cd6a5ad4badb None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.495771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.496513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.496801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.497079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.497796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:01.498133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.499507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.511686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 548/1066] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:01.512483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.556372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a5418-166c-4f53-b41f-0ba754194dd2 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.591111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.591768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.592054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.592340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.593174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b, user.id=362f45afe36f4ae2a1b45871a3db10bb) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:01.593492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.594978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.600711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 519/1067] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/role_assignments?user.id=362f45afe36f4ae2a1b45871a3db10bb&scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:01.601502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.613527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba2139-e9b0-4445-a4d4-8379dfd01485 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.653635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.654612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.654915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.655192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.655878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:01.656185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.657612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.663566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 549/1068] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:01.667655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.669581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.694704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.735473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2619a15-b92f-49c6-8f20-4e213b38ad2e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.780712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.781573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.781896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.782226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.783169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2cac-4d46-473a-af74-806da2a6bde0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.789574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.791824 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:05:01.807383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:01.808334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:05:01.809247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:01.810701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 520/1069] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:01.814205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:01.819334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.820004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.820293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.820573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.821445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.822860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.885663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 550/1070] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:05:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:05:01.915651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:01.919978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ee214-0239-4d2c-b1d2-eaae10d9be38 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:01.966320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:01.967001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:01.967285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:01.967564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:01.968357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:01.968671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:01.970181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7f17-b742-4ddb-8370-f29614a06682 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:01.989042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 521/1071] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:05:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:01.990964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:02.077248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:02.102061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba1d03-dbb0-483b-aa56-ac81b846575d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:02.137401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae4bd-9dde-4c1e-9aec-bc39f41c3172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:02.138330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae4bd-9dde-4c1e-9aec-bc39f41c3172 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:02.138609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae4bd-9dde-4c1e-9aec-bc39f41c3172 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:02.138880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae4bd-9dde-4c1e-9aec-bc39f41c3172 None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/75c9161930b64f0e910a4a3323fa733a/roles/e061d37653c04871bca908057dbb9ed3` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:02.141062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae4bd-9dde-4c1e-9aec-bc39f41c3172 None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=75c9161930b64f0e910a4a3323fa733a, role_id=e061d37653c04871bca908057dbb9ed3)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:02.142519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae4bd-9dde-4c1e-9aec-bc39f41c3172 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:02.210422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 551/1072] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:05:01 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/75c9161930b64f0e910a4a3323fa733a/roles/e061d37653c04871bca908057dbb9ed3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:05:03.649535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c42a-6d67-4ebd-a655-e4e58a568183 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:03.650196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c42a-6d67-4ebd-a655-e4e58a568183 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:03.650196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c42a-6d67-4ebd-a655-e4e58a568183 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:03.651445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 522/1073] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:03.657215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:03.657610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:03.657789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:03.674841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:03.676023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:03.745071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 552/1074] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:03.767761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c42a-6d67-4ebd-a655-e4e58a568183 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:03.871283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c42a-6d67-4ebd-a655-e4e58a568183 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:03.905605 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efba6-8e00-4566-9041-5ef08d470620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:03.906353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efba6-8e00-4566-9041-5ef08d470620 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:03.906638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efba6-8e00-4566-9041-5ef08d470620 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:03.906913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efba6-8e00-4566-9041-5ef08d470620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:03.917738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efba6-8e00-4566-9041-5ef08d470620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3e1efba6-8e00-4566-9041-5ef08d470620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:03.925411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:03.926420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:03.927297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:03.929876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 523/1075] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:03.933358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:03.998983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.019321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43fbdc-cf80-4f09-bc06-3ad1d70ddee8 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.019656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43fbdc-cf80-4f09-bc06-3ad1d70ddee8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.019899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43fbdc-cf80-4f09-bc06-3ad1d70ddee8 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.021529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 524/1076] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:04.027102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.027390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.027671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.035331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9571e4-5ba5-4702-8d00-00d966fb0461 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.046571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:04.047770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:04.057837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.082357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.083036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.083451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.083645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.084406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:04.084720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.086139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.095924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 553/1077] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:04.101334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.125907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 525/1078] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:05:04.148608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.209270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f06f5-3fda-4853-9b93-b232382be1e0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.239018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.248172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.250674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.250674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.250674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] PATH_INFO: `/v3/users/362f45afe36f4ae2a1b45871a3db10bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.250925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] RBAC: Authorizing `identity:get_user(user_id=362f45afe36f4ae2a1b45871a3db10bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.252306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.253361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992f8d6-2e37-499d-9b97-223e39fc54ee None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.254186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 554/1079] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/users/362f45afe36f4ae2a1b45871a3db10bb => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:04.259627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.294015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f2fea-4b8f-48da-a37c-7f02bc9a0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.294668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2fea-4b8f-48da-a37c-7f02bc9a0ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.294955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2fea-4b8f-48da-a37c-7f02bc9a0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.295231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f2fea-4b8f-48da-a37c-7f02bc9a0ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.309549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.359982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac06a79-a729-46e4-b66b-e4e49f3e6c63 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.363042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f2fea-4b8f-48da-a37c-7f02bc9a0ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.364521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f2fea-4b8f-48da-a37c-7f02bc9a0ef6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.393985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd8cb3-8890-43cd-af90-bde998d91f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.394841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8cb3-8890-43cd-af90-bde998d91f4a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.395123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8cb3-8890-43cd-af90-bde998d91f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.395397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd8cb3-8890-43cd-af90-bde998d91f4a None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.396565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd8cb3-8890-43cd-af90-bde998d91f4a None admin] RBAC: Authorizing `identity:get_project(project_id=8b57b7432caa49c8a9fa01b86fa0885b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.398038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd8cb3-8890-43cd-af90-bde998d91f4a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.400294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 555/1080] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:04.401478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ce46-8d9c-471b-9e06-b403d3c2d3d5 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.401758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ce46-8d9c-471b-9e06-b403d3c2d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.402066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ce46-8d9c-471b-9e06-b403d3c2d3d5 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.403589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 556/1081] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:04.406833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686ce46-8d9c-471b-9e06-b403d3c2d3d5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.464496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 526/1082] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:05:04.465795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.466115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.466389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.471696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.481850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:04.483045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:04.510664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686ce46-8d9c-471b-9e06-b403d3c2d3d5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.524798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.546088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.547017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.547330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.547607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b/users/362f45afe36f4ae2a1b45871a3db10bb/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.549562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b57b7432caa49c8a9fa01b86fa0885b, user_id=362f45afe36f4ae2a1b45871a3db10bb, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.551159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.552066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 527/1083] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:04.552973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.659060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ef586-0977-422a-8cf7-7d41477e762e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.685251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 557/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:05:04 2022] PUT /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b/users/362f45afe36f4ae2a1b45871a3db10bb/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:05:04.686112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.693541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.697024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.697024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.697024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.708171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.709763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:05:04.729789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:04.730823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:04.732198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:05:04.732198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:05:04.732198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:04.732198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:04.732198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 528/1085] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:04.737284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.768822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.815653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe03365-6187-4c65-968d-f6dc95b3e4d1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.852843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:04.865745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.866731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.867128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.867363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.876136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5159-5ecd-4a58-b28c-3669fc739708 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:04.878878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:04.888224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:04.889368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:04.890644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 558/1086] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:04.896345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:04.917889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:04.918565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:04.918853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:04.919137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:04.919868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:04.920183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:04.921656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:04.933728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 529/1087] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:05.010957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c55fd-8864-4f03-b962-420d5f4aa02c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:05.051382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:05.052169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:05.052514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:05.052853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:05.053688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:05.054092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:05.055712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:05.065913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 559/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:05:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:05.073850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:05.179295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:05.196361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276404-cf86-458b-b4ae-edf28c64af16 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:05.264130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:05.264851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:05.265135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:05.265412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:05.276142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:05.277591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:05:05.294846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:05.295763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:05.296706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:05:05.296706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:05:05.296706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:05.296706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:05.297959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 530/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:05.301622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:05.348326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:05.401815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e57603-ecdd-42af-8b0a-b0b972d54c19 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:05.435418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:05.436090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:05.436376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:05.436654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:05.437376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:05.437688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:05.439238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:05.451769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 560/1090] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:05.457263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:05.556562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e464887-314e-46fd-814c-6668c8f1bb3a None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:05.589588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:05.590393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:05.590679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:05.590958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:05.597717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:05.599195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:05.600879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:05:05.615636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:05.616644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:05.618690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 531/1091] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jun 20 12:05:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:05.623197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:05.720896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf1cba-e2ba-4cea-8d2c-4d306fbab03e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:05.728620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:05.754461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:05.755130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:05.755415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:05.755691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:05.756517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:05.756829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:05.758406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:05.777324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 561/1092] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jun 20 12:05:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:05.783379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:05.886444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e0d3d-f3fb-4d11-a24c-f66ec1268c7d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:05.920031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:05.920673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:05.920957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:05.921238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:05.983983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:05.987591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:05.989051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:06.091449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 532/1093] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:06.097250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:06.194088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571b0c0-71f1-48e4-882a-9022546396c5 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:06.227503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:06.228287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.228568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.228837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.238669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:06.240113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:05:06.257623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:06.259356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:06.260292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:05:06.260292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:05:06.260292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:05:06.260292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:06.260292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 562/1094] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:06.265047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:06.357509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:06.361349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e864f-e2bc-4690-be6d-96ad6e0a40ac None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:06.396293 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:06.396963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.397247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.397523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.398269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:06.398582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:06.399994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:06.411578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 533/1095] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:06.417450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:06.435741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:06.517137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf19dc0-67d5-4960-b53a-b4a96a6bd8fb None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:06.550386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:06.551170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.551530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.551809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.559079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:06.560520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:05:06.574590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:06.575562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:06.576571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 563/1096] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:05:06.581629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:06.680897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6eb562-21ac-4a86-b1d1-7e3a0a1cebde None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:06.713266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:06.713957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.714245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.714523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.715304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:06.715616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:06.717048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7971fb6-2765-4efa-961a-005bf1371c0a None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:06.729452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 534/1097] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:06.735395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:06.749314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7ad6d-008a-4fd1-af1e-993be140182e None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.749612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7ad6d-008a-4fd1-af1e-993be140182e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.749926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7ad6d-008a-4fd1-af1e-993be140182e None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.751299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 535/1098] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:05:06.756281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.756576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.756857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.773712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:06.775706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:06.788902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:06.814187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:06.837958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3266c3-8d18-4392-9199-3094dd31e389 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:06.842589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 536/1099] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:06.866456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:06.873444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:06.874140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:06.874429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:06.874710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:06.875543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] RBAC: Adding query filter params (role.id=e061d37653c04871bca908057dbb9ed3, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=75c9161930b64f0e910a4a3323fa733a) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:06.875860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:06.877328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:06.911850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 564/1100] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:06 2022] GET /identity/v3/role_assignments?user.id=75c9161930b64f0e910a4a3323fa733a&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=e061d37653c04871bca908057dbb9ed3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:05:06.987913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba2ea6-2075-443d-a202-0048e1950e9b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:07.023323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:07.024695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:07.025101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:07.025389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:07.036475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:07.045250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:07.046439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:07.047312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 537/1101] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:05:07.054253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:07.163102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fab049-095c-4c28-9d34-5f308f9d2eee None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:07.198626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:07.199306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:07.199592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:07.199872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:07.200627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:07.200936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:07.202371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:07.211952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 565/1102] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:07.218002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:07.231393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:07.322206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ff630-add5-4ecd-8e1b-b5f82d240544 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:07.356611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:07.357491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:07.357780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:07.358090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] PATH_INFO: `/v3/users/362f45afe36f4ae2a1b45871a3db10bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:07.359291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] RBAC: Authorizing `identity:get_user(user_id=362f45afe36f4ae2a1b45871a3db10bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:07.360742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:07.362402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 538/1103] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:07 2022] GET /identity/v3/users/362f45afe36f4ae2a1b45871a3db10bb => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:07.368703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:07.371745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:07.474222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8d8a-21aa-445b-9f0f-6d036a7c18a0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:07.510021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:07.510684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:07.511167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:07.511457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:07.581510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:07.583002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:07.584934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:07.686053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 566/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:07.694393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:07.776970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:07.800220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10ba41-b546-449c-8acd-4069e75fe793 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:07.832187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77925154-1190-4265-9a67-6a322e1dda7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:07.832987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77925154-1190-4265-9a67-6a322e1dda7b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:07.833274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77925154-1190-4265-9a67-6a322e1dda7b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:07.833554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77925154-1190-4265-9a67-6a322e1dda7b None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:07.834754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77925154-1190-4265-9a67-6a322e1dda7b None admin] RBAC: Authorizing `identity:get_project(project_id=8b57b7432caa49c8a9fa01b86fa0885b)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:07.836199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77925154-1190-4265-9a67-6a322e1dda7b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:07.838443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 539/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:07 2022] GET /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:07.844695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:07.948992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726237f-7bf8-40d2-bf74-8bb8e8a3bea1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:07.950520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:07.983751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:07.984397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:07.984684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:07.984963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:07.985779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b, user.id=362f45afe36f4ae2a1b45871a3db10bb) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:07.986127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:07.987557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d583bb-5a29-4079-84d3-10e956303aa2 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:07.993339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 567/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:07 2022] GET /identity/v3/role_assignments?user.id=362f45afe36f4ae2a1b45871a3db10bb&scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:10.056637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaa39-5f37-4478-bd3c-1f5c29cdd47a None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:10.057244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaa39-5f37-4478-bd3c-1f5c29cdd47a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:10.057244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaa39-5f37-4478-bd3c-1f5c29cdd47a None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:10.058610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 540/1107] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:10.063823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:10.064247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:10.064357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:10.081453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:10.082667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:10.147185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 568/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:10.172307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaa39-5f37-4478-bd3c-1f5c29cdd47a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:10.273676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaa39-5f37-4478-bd3c-1f5c29cdd47a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:10.307121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a797daa-7571-451f-ab0a-b031f3289953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:10.307847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797daa-7571-451f-ab0a-b031f3289953 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:10.308137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797daa-7571-451f-ab0a-b031f3289953 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:10.308419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a797daa-7571-451f-ab0a-b031f3289953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:10.309588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797daa-7571-451f-ab0a-b031f3289953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:10.311103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a797daa-7571-451f-ab0a-b031f3289953 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:10.312696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 541/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:10.318559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:10.410850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:10.417170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342cc99-7298-4b25-a379-f1bff14f267c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:10.452844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1727a-873b-44d8-beb5-edd49a094248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:10.453566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1727a-873b-44d8-beb5-edd49a094248 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:10.453900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1727a-873b-44d8-beb5-edd49a094248 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:10.454217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1727a-873b-44d8-beb5-edd49a094248 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:10.454992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1727a-873b-44d8-beb5-edd49a094248 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:10.456617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1727a-873b-44d8-beb5-edd49a094248 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:10.518438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 569/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:05:10 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:05:12.587692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d257b-53f2-4ae3-9eff-01f4296343ae None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:12.588247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d257b-53f2-4ae3-9eff-01f4296343ae None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:12.588247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d257b-53f2-4ae3-9eff-01f4296343ae None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:12.589617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 542/1111] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:12.594685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:12.595082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:12.595246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:12.612640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:12.613846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:12.679321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 570/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:12.703543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d257b-53f2-4ae3-9eff-01f4296343ae None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:12.718525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:12.803992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d257b-53f2-4ae3-9eff-01f4296343ae None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:12.836658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:12.837509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:12.837864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:12.838148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] PATH_INFO: `/v3/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:12.839626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] RBAC: Authorizing `identity:get_role(role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:12.841003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:12.842393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 543/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:12 2022] GET /identity/v3/roles/dec207b48f6f4beb9cc4250b08307111 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:12.848136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:12.928549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:12.946583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca491c0f-2deb-4827-9f2c-3d4552a4c1f1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:12.981337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:12.982231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:12.982520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:12.982798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] PATH_INFO: `/v3/users/84e9cf7373c141daa72d625c43bf2e49` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:12.995213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] RBAC: Authorizing `identity:get_user(user_id=84e9cf7373c141daa72d625c43bf2e49)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:12.996655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:12.998327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 571/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:12 2022] GET /identity/v3/users/84e9cf7373c141daa72d625c43bf2e49 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:13.004070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:13.090502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:13.111434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725832-3a0a-469e-8016-7d5ba12ecfc9 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:13.144206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:13.144855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:13.145145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:13.145428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:13.214307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:13.215761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:13.295303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:13.315018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 544/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:13.320626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:13.421129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453021b1-c677-4cb9-87d1-1962cd977796 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:13.454081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf582f-1bbf-4a7c-b952-7753922bc62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:13.454932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf582f-1bbf-4a7c-b952-7753922bc62f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:13.455213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf582f-1bbf-4a7c-b952-7753922bc62f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:13.455482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf582f-1bbf-4a7c-b952-7753922bc62f None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:13.456646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf582f-1bbf-4a7c-b952-7753922bc62f None admin] RBAC: Authorizing `identity:get_project(project_id=8b57b7432caa49c8a9fa01b86fa0885b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:13.458088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf582f-1bbf-4a7c-b952-7753922bc62f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:13.459762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 572/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:13 2022] GET /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:13.465953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:13.562843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2473f-ce11-4e7b-871b-dc19547ab123 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:13.595838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:13.596482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:13.596768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:13.597048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:13.597974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] RBAC: Adding query filter params (role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b, user.id=84e9cf7373c141daa72d625c43bf2e49) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:13.598292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:13.599730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a632a-c19b-4fbd-9148-48b085447a90 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:13.605514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 545/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:13 2022] GET /identity/v3/role_assignments?user.id=84e9cf7373c141daa72d625c43bf2e49&scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:15.603470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178204-74a4-45b2-9784-7557cae5eec5 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:15.603995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178204-74a4-45b2-9784-7557cae5eec5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:15.604106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98178204-74a4-45b2-9784-7557cae5eec5 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:15.605392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 573/1118] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:15.610886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:15.611282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:15.611453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:15.628227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:15.629413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:15.669052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:15.695084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 546/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:15.719415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178204-74a4-45b2-9784-7557cae5eec5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:15.730751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:15.818288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98178204-74a4-45b2-9784-7557cae5eec5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:15.851336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:15.852211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:15.852586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:15.852865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] PATH_INFO: `/v3/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:15.854412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] RBAC: Authorizing `identity:get_role(role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:15.855723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:15.857084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 574/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:15 2022] GET /identity/v3/roles/dec207b48f6f4beb9cc4250b08307111 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:15.863385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:15.961919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafe961-7746-428e-8ac2-2d45ae903bf5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:15.994950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:15.995813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:15.996099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:15.996376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] PATH_INFO: `/v3/users/84e9cf7373c141daa72d625c43bf2e49` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:15.997554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=84e9cf7373c141daa72d625c43bf2e49)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:15.999036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:16.000639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 547/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:15 2022] GET /identity/v3/users/84e9cf7373c141daa72d625c43bf2e49 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:16.006433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:16.086424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:16.109521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f33e9-1556-45b1-970b-747cdd16f5a1 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:16.143630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7098ed5-3c4f-45b1-b9fa-0957b5a66e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:16.144477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7098ed5-3c4f-45b1-b9fa-0957b5a66e85 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:16.144762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7098ed5-3c4f-45b1-b9fa-0957b5a66e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:16.145037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7098ed5-3c4f-45b1-b9fa-0957b5a66e85 None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:16.146227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7098ed5-3c4f-45b1-b9fa-0957b5a66e85 None admin] RBAC: Authorizing `identity:get_project(project_id=8b57b7432caa49c8a9fa01b86fa0885b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:16.147657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7098ed5-3c4f-45b1-b9fa-0957b5a66e85 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:16.149358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 575/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:16 2022] GET /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:16.155466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:16.198179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:16.252170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c77d2-bd11-4296-bf8a-3035073b8bd0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:16.285753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a253c-8a2f-4337-8056-39ea5f009baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:16.286671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a253c-8a2f-4337-8056-39ea5f009baf None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:16.286959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a253c-8a2f-4337-8056-39ea5f009baf None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:16.287241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a253c-8a2f-4337-8056-39ea5f009baf None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b/users/84e9cf7373c141daa72d625c43bf2e49/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:16.290005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a253c-8a2f-4337-8056-39ea5f009baf None admin] RBAC: Authorizing `identity:create_grant(project_id=8b57b7432caa49c8a9fa01b86fa0885b, user_id=84e9cf7373c141daa72d625c43bf2e49, role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:16.291436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a253c-8a2f-4337-8056-39ea5f009baf None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:16.364109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 548/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:05:16 2022] PUT /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b/users/84e9cf7373c141daa72d625c43bf2e49/roles/dec207b48f6f4beb9cc4250b08307111 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:05:18.417181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc78-4a72-48b4-beb3-61026032b998 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:18.417701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc78-4a72-48b4-beb3-61026032b998 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:18.417701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ebc78-4a72-48b4-beb3-61026032b998 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:18.419078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 576/1124] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:18.424169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:18.424561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:18.424738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:18.441682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:18.442972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:18.509190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 549/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:18.533067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc78-4a72-48b4-beb3-61026032b998 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:18.636041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ebc78-4a72-48b4-beb3-61026032b998 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:18.668779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:18.669563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:18.669864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:18.670138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] PATH_INFO: `/v3/roles/dec207b48f6f4beb9cc4250b08307111` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:18.671591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] RBAC: Authorizing `identity:get_role(role_id=dec207b48f6f4beb9cc4250b08307111)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:18.672957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:18.674348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 577/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:18 2022] GET /identity/v3/roles/dec207b48f6f4beb9cc4250b08307111 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:18.680861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:18.710272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:18.778021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2627a-8520-4ce3-8837-b5173c1dfd91 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:18.811607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:18.812467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:18.812751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:18.813027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] PATH_INFO: `/v3/users/84e9cf7373c141daa72d625c43bf2e49` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:18.814249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] RBAC: Authorizing `identity:get_user(user_id=84e9cf7373c141daa72d625c43bf2e49)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:18.815702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:18.817309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 550/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:18 2022] GET /identity/v3/users/84e9cf7373c141daa72d625c43bf2e49 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:18.823093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:18.838365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:18.922512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c5317-8eff-438c-a4d6-f41d8df8e6f4 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:18.956081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:18.956727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:18.957015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:18.957297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:19.023229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:19.025211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:19.038388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:19.122030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 578/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:19.127822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:19.222554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:19.225318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92975e-c26a-45c1-9d2e-0875dea9598b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:19.258917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf38c98-268f-4fd3-8a50-bec2d7723b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:19.259805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf38c98-268f-4fd3-8a50-bec2d7723b10 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:19.260096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf38c98-268f-4fd3-8a50-bec2d7723b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:19.260382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf38c98-268f-4fd3-8a50-bec2d7723b10 None admin] PATH_INFO: `/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:19.261725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf38c98-268f-4fd3-8a50-bec2d7723b10 None admin] RBAC: Authorizing `identity:get_project(project_id=8b57b7432caa49c8a9fa01b86fa0885b)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:19.263292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf38c98-268f-4fd3-8a50-bec2d7723b10 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:19.265156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 551/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:19 2022] GET /identity/v3/projects/8b57b7432caa49c8a9fa01b86fa0885b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:19.271195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:19.367916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0b09d-ea4a-47a7-9a0f-0e1c0ffc3d0d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:19.380445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:19.401681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:19.402346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:19.402629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:19.402906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:19.403723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] RBAC: Adding query filter params (role.id=dec207b48f6f4beb9cc4250b08307111, scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b, user.id=84e9cf7373c141daa72d625c43bf2e49) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:19.404038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:19.405726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88168b92-5e9b-44d6-8add-d322b2273416 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:19.411819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 579/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:19 2022] GET /identity/v3/role_assignments?user.id=84e9cf7373c141daa72d625c43bf2e49&scope.project.id=8b57b7432caa49c8a9fa01b86fa0885b&role.id=dec207b48f6f4beb9cc4250b08307111 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:21.467220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135ae26-e818-407e-b7ef-96963d95bf25 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:21.467748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135ae26-e818-407e-b7ef-96963d95bf25 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:21.467748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135ae26-e818-407e-b7ef-96963d95bf25 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:21.469080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 552/1131] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:21.474155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:21.474591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:21.474701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:21.491912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:21.493915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:21.558741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 580/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:21.582697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135ae26-e818-407e-b7ef-96963d95bf25 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:21.681872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135ae26-e818-407e-b7ef-96963d95bf25 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:21.715718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e10f2-46cb-40dc-acf0-88e9f9877403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:21.716499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e10f2-46cb-40dc-acf0-88e9f9877403 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:21.716783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e10f2-46cb-40dc-acf0-88e9f9877403 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:21.717057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e10f2-46cb-40dc-acf0-88e9f9877403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:21.718293 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e10f2-46cb-40dc-acf0-88e9f9877403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:21.719717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e10f2-46cb-40dc-acf0-88e9f9877403 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:21.721324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 553/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:21.727964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:21.823907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273987a-646e-43bd-bcc1-a750ca976476 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:21.830914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:21.856608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdddf2-3c3a-4e8d-b362-b88d46da9d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:21.857260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdddf2-3c3a-4e8d-b362-b88d46da9d5e None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:21.857541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdddf2-3c3a-4e8d-b362-b88d46da9d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:21.857836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdddf2-3c3a-4e8d-b362-b88d46da9d5e None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:21.858543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdddf2-3c3a-4e8d-b362-b88d46da9d5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:21.860021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdddf2-3c3a-4e8d-b362-b88d46da9d5e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:21.953385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 581/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:05:21 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:05:24.014577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e2ae-10d4-49ff-81e8-528e5d7d5e25 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:24.015147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e2ae-10d4-49ff-81e8-528e5d7d5e25 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:24.015147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e2ae-10d4-49ff-81e8-528e5d7d5e25 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:24.016506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 554/1135] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:24.021750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:24.022187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:24.022334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:24.039567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:24.040744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:24.106581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 582/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:24.131532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e2ae-10d4-49ff-81e8-528e5d7d5e25 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:24.167879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:24.232835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e2ae-10d4-49ff-81e8-528e5d7d5e25 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:24.265719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00518c-8f68-468f-b6da-057c0820d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:24.266473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00518c-8f68-468f-b6da-057c0820d149 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:24.266760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00518c-8f68-468f-b6da-057c0820d149 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:24.267041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00518c-8f68-468f-b6da-057c0820d149 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:24.268214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00518c-8f68-468f-b6da-057c0820d149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:24.269645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00518c-8f68-468f-b6da-057c0820d149 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:24.271347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 555/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:24.277714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:24.364688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:24.376582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35115d3-fd93-43ca-8709-28c3d8708d21 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:24.410713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d8bb-8cf7-4bd7-98de-78a9ae889bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:24.411367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d8bb-8cf7-4bd7-98de-78a9ae889bb0 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:24.411650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d8bb-8cf7-4bd7-98de-78a9ae889bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:24.411922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d8bb-8cf7-4bd7-98de-78a9ae889bb0 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:24.412620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d8bb-8cf7-4bd7-98de-78a9ae889bb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:24.414161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d8bb-8cf7-4bd7-98de-78a9ae889bb0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:24.488862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 583/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:05:24 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:05:26.544815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d49462-b56f-4dde-84da-cb7b076fd92e None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:26.545354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d49462-b56f-4dde-84da-cb7b076fd92e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:26.545461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d49462-b56f-4dde-84da-cb7b076fd92e None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:26.546793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 556/1139] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:26.552022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:26.552446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:26.552589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:26.569603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:26.571455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:26.636284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 584/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:26.660265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d49462-b56f-4dde-84da-cb7b076fd92e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:26.760104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d49462-b56f-4dde-84da-cb7b076fd92e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:26.762338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:26.793183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:26.794007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:26.794286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:26.794561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:26.805160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:26.812643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:26.813852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:26.814813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 557/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:26.819848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:26.892367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:26.917714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f7f5c-ca32-4d6b-a58b-a4ecb120eed7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:26.955403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:26.956064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:26.956349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:26.956623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:26.957362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:26.957666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:26.959060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:26.967797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 585/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:26.973511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:27.074256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67bb19-1844-422a-9196-ac2df1c83ad3 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:27.111587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:27.113065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:27.113353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:27.113631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] PATH_INFO: `/v3/users/ed64c0f6e6c145f491448e08050c2184` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:27.128767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed64c0f6e6c145f491448e08050c2184)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:27.130269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:27.131931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 558/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:26 2022] GET /identity/v3/users/ed64c0f6e6c145f491448e08050c2184 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:27.138408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:27.244901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb7d5d-8ae1-4afb-a2ad-7b742a2fd72f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:27.287530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:27.288187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:27.288690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:27.289296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:27.294390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:27.359742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:27.361103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:27.461042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 586/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:27.466828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:27.490800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:27.567922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075177-6041-469f-83c9-5566ea41f5d0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:27.602886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb84d-995a-467f-83bd-e707be1f145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:27.603750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb84d-995a-467f-83bd-e707be1f145d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:27.604028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb84d-995a-467f-83bd-e707be1f145d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:27.604303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb84d-995a-467f-83bd-e707be1f145d None admin] PATH_INFO: `/v3/projects/591df5928e254684ac193acb02cadeb2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:27.606218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfb84d-995a-467f-83bd-e707be1f145d None admin] RBAC: Authorizing `identity:get_project(project_id=591df5928e254684ac193acb02cadeb2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:27.607665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfb84d-995a-467f-83bd-e707be1f145d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:27.609358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 559/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:27 2022] GET /identity/v3/projects/591df5928e254684ac193acb02cadeb2 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:27.616074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:27.650792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:27.717778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42c5d5-b3fd-40cc-967f-57bbec83c2d6 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:27.752547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:27.753199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:27.753484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:27.753763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:27.754618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=591df5928e254684ac193acb02cadeb2, user.id=ed64c0f6e6c145f491448e08050c2184) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:27.754936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:27.756370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d855bc4-8579-41c0-a2a1-a6e9ab53ebf9 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:27.762774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 587/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:27 2022] GET /identity/v3/role_assignments?user.id=ed64c0f6e6c145f491448e08050c2184&scope.project.id=591df5928e254684ac193acb02cadeb2&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:29.807168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe6f9-dd47-431d-b7a5-bb1f4a17a5fd None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:29.807722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe6f9-dd47-431d-b7a5-bb1f4a17a5fd None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:29.807722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe6f9-dd47-431d-b7a5-bb1f4a17a5fd None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:29.809075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 560/1147] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:29.814240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:29.814678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:29.814801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:29.832501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:29.833707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:29.897928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 588/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:29.921494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe6f9-dd47-431d-b7a5-bb1f4a17a5fd None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:30.011911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:30.021553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe6f9-dd47-431d-b7a5-bb1f4a17a5fd None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:30.056332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:30.057114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:30.057445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:30.057671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:30.067463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:30.075953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:30.076912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:30.077790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 561/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:30.083416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:30.112754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:30.180334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5ec6f-3fd8-4e55-a498-3d70c2457dfe None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:30.213500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:30.214185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:30.214473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:30.214753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:30.215499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:30.215808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:30.217178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:30.225034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 589/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:30.231372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:30.329075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fdfac-8d32-47d4-bc06-185aa72871ef None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:30.362959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:30.363822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:30.364109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:30.364389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] PATH_INFO: `/v3/users/ed64c0f6e6c145f491448e08050c2184` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:30.365577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] RBAC: Authorizing `identity:get_user(user_id=ed64c0f6e6c145f491448e08050c2184)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:30.367181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:30.368870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 562/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:30 2022] GET /identity/v3/users/ed64c0f6e6c145f491448e08050c2184 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:30.374595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:30.463868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:30.472136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e0140-9dd3-481a-babb-5f961143e853 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:30.504209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc97196-a790-4851-b207-98301573f465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:30.505056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97196-a790-4851-b207-98301573f465 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:30.505342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97196-a790-4851-b207-98301573f465 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:30.505619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97196-a790-4851-b207-98301573f465 None admin] PATH_INFO: `/v3/projects/591df5928e254684ac193acb02cadeb2` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:30.506823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc97196-a790-4851-b207-98301573f465 None admin] RBAC: Authorizing `identity:get_project(project_id=591df5928e254684ac193acb02cadeb2)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:30.508291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc97196-a790-4851-b207-98301573f465 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:30.510006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 590/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:30 2022] GET /identity/v3/projects/591df5928e254684ac193acb02cadeb2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:30.516096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:30.535792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:30.613701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7cea3-f52c-4516-9d11-705f01e119dc None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:30.646046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff4ee3-d2bf-483e-a05c-77e839c32276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:30.647262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4ee3-d2bf-483e-a05c-77e839c32276 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:30.647551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4ee3-d2bf-483e-a05c-77e839c32276 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:30.647830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff4ee3-d2bf-483e-a05c-77e839c32276 None admin] PATH_INFO: `/v3/projects/591df5928e254684ac193acb02cadeb2/users/ed64c0f6e6c145f491448e08050c2184/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:30.650404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4ee3-d2bf-483e-a05c-77e839c32276 None admin] RBAC: Authorizing `identity:create_grant(project_id=591df5928e254684ac193acb02cadeb2, user_id=ed64c0f6e6c145f491448e08050c2184, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:30.651847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff4ee3-d2bf-483e-a05c-77e839c32276 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:30.751826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 563/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:05:30 2022] PUT /identity/v3/projects/591df5928e254684ac193acb02cadeb2/users/ed64c0f6e6c145f491448e08050c2184/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:05:32.747735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913d5e-a228-46c9-88d7-b623b9914d51 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:32.748269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913d5e-a228-46c9-88d7-b623b9914d51 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:32.748269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33913d5e-a228-46c9-88d7-b623b9914d51 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:32.749670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 591/1154] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:32.754858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:32.755280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:32.755494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:32.772733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:32.774061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:32.839389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 564/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 12:05:32.863396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33913d5e-a228-46c9-88d7-b623b9914d51 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:32.961788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33913d5e-a228-46c9-88d7-b623b9914d51 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:32.994167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:32.994947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:32.995231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:32.995509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:33.005752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:33.013780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:33.014922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:33.015980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 592/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:33.020909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:33.032015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:33.118756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3047625-ccf2-4d5f-a854-7463491d67a7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:33.152083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:33.152740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:33.153024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:33.153299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:33.154064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:33.154636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:33.156003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:33.163734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 565/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:33.169662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:33.191581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:33.268246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f417ceb-027a-4159-884b-0b4f25cc3d39 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:33.301170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:33.302079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:33.302367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:33.302647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] PATH_INFO: `/v3/users/ed64c0f6e6c145f491448e08050c2184` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:33.303824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=ed64c0f6e6c145f491448e08050c2184)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:33.305783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:33.307441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 593/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:33 2022] GET /identity/v3/users/ed64c0f6e6c145f491448e08050c2184 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:33.313194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:33.381019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:33.412238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d1aa8-a06b-4261-abbc-5ec2f91bcb08 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:33.446027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:33.446671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:33.446953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:33.447228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:33.513414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:33.514909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:33.579414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:33.610661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 566/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:33.615864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:33.702346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:33.721975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b8cac-6af2-452a-b8f8-62c71b6bb8f7 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:33.757294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a6fe3-09a1-44c1-98e2-c0570fca1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:33.758374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6fe3-09a1-44c1-98e2-c0570fca1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:33.758660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6fe3-09a1-44c1-98e2-c0570fca1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:33.758937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a6fe3-09a1-44c1-98e2-c0570fca1ce0 None admin] PATH_INFO: `/v3/projects/591df5928e254684ac193acb02cadeb2` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:33.760115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6fe3-09a1-44c1-98e2-c0570fca1ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=591df5928e254684ac193acb02cadeb2)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:33.761555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a6fe3-09a1-44c1-98e2-c0570fca1ce0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:33.763325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 594/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:33 2022] GET /identity/v3/projects/591df5928e254684ac193acb02cadeb2 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:33.769490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:33.866907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62075a-7810-4919-bcb6-60d0050e2f06 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:33.899739 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:33.900387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:33.900672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:33.900948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:33.901771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=591df5928e254684ac193acb02cadeb2, user.id=ed64c0f6e6c145f491448e08050c2184) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:33.902118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:33.903588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebdc51-2a8b-4f46-bae8-8d980e312986 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:33.909482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 567/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:33 2022] GET /identity/v3/role_assignments?user.id=ed64c0f6e6c145f491448e08050c2184&scope.project.id=591df5928e254684ac193acb02cadeb2&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:35.957063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a4da-5a53-471d-8594-82adf4ccf9f7 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:35.957595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a4da-5a53-471d-8594-82adf4ccf9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:35.957595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4a4da-5a53-471d-8594-82adf4ccf9f7 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:35.959010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 595/1162] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:35.964121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:35.964500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:35.964688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:35.981552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:35.982771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:36.008978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:36.047964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 568/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:36.071269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a4da-5a53-471d-8594-82adf4ccf9f7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:36.173271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4a4da-5a53-471d-8594-82adf4ccf9f7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:36.207255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:36.207834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:36.208122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:36.208399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:36.232464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:36.274855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:36.276307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:36.371604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 596/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:36.377769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:36.475613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833a080-30ef-46c9-9704-7c2ed5540597 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:36.511602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:36.512402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:36.512687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:36.512963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:36.519885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:36.521370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-ede45d88-9e8a-4256-9018-40e5a3929bd0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:36.536591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:36.537848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:36.539151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 569/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:05:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:36.544282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:36.599056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:36.641239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f66e78-dc2f-4f94-b522-031748020ea9 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:36.675025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:36.675756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:36.676045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:36.676326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:36.677050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:36.677360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:36.678766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b695f-f7b0-4fd9-af26-f827a5b37ecf None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:36.685787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 597/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jun 20 12:05:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:38.703838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43184-5145-4981-888f-54573ec6157c None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:38.704403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43184-5145-4981-888f-54573ec6157c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:38.704403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc43184-5145-4981-888f-54573ec6157c None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:38.705789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 570/1167] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:38.711629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289843e-97f7-47fc-9ada-0c8d9dbf5ecb None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:38.712068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289843e-97f7-47fc-9ada-0c8d9dbf5ecb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:38.712187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289843e-97f7-47fc-9ada-0c8d9dbf5ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:38.729183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5289843e-97f7-47fc-9ada-0c8d9dbf5ecb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:38.730392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5289843e-97f7-47fc-9ada-0c8d9dbf5ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:38.795133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 598/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:38.817979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43184-5145-4981-888f-54573ec6157c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:38.844315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:38.919190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc43184-5145-4981-888f-54573ec6157c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:38.953977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4148-0a7a-4199-9d20-1e769b1180a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:38.954564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4148-0a7a-4199-9d20-1e769b1180a5 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:38.954841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4148-0a7a-4199-9d20-1e769b1180a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:38.955116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4148-0a7a-4199-9d20-1e769b1180a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:38.955853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4148-0a7a-4199-9d20-1e769b1180a5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:38.957235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4148-0a7a-4199-9d20-1e769b1180a5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:39.027795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 571/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Mon Jun 20 12:05:38 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:05:41.099296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271f79-4e52-425c-bf6d-183313b2bac7 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:41.099761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271f79-4e52-425c-bf6d-183313b2bac7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:41.099855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9271f79-4e52-425c-bf6d-183313b2bac7 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:41.101282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 599/1170] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:41.106571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:41.106989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:41.107144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:41.123762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:41.124951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:41.191822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 572/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:41.216505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9271f79-4e52-425c-bf6d-183313b2bac7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:41.266167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:41.315252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9271f79-4e52-425c-bf6d-183313b2bac7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:41.348602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e316b55-a2c2-41c1-a549-7083a70e08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:41.349388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e316b55-a2c2-41c1-a549-7083a70e08f5 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:41.349671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e316b55-a2c2-41c1-a549-7083a70e08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:41.349980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e316b55-a2c2-41c1-a549-7083a70e08f5 None admin] PATH_INFO: `/v3/domains/a4b8ffc9450f496b9c23d4cfbfbe4c9c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:41.360940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e316b55-a2c2-41c1-a549-7083a70e08f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a4b8ffc9450f496b9c23d4cfbfbe4c9c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:41.362509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e316b55-a2c2-41c1-a549-7083a70e08f5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:41.364132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 600/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Mon Jun 20 12:05:41 2022] GET /identity/v3/domains/a4b8ffc9450f496b9c23d4cfbfbe4c9c => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:41.370580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:41.385214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:41.467076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2be9-864c-4a6f-a0d3-fabbd81dc015 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:41.499961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948e18-2944-43f0-84c4-054d087b13c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:41.500614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948e18-2944-43f0-84c4-054d087b13c3 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:41.500900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948e18-2944-43f0-84c4-054d087b13c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:41.501179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948e18-2944-43f0-84c4-054d087b13c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:41.501918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9948e18-2944-43f0-84c4-054d087b13c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:41.503376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9948e18-2944-43f0-84c4-054d087b13c3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:41.581145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 573/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:05:41 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:05:43.653643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507976-fa90-4410-a44b-d61be5238d11 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:43.654463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507976-fa90-4410-a44b-d61be5238d11 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:43.654580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8507976-fa90-4410-a44b-d61be5238d11 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:43.655870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 601/1174] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:43.661048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:43.661497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:43.661601 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:43.678047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:43.679822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:43.737226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:43.744971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 574/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:43.771334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507976-fa90-4410-a44b-d61be5238d11 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:43.872006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8507976-fa90-4410-a44b-d61be5238d11 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:43.881752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:43.904950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0956a0-417c-4c8e-89ad-a17d5832c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:43.905886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0956a0-417c-4c8e-89ad-a17d5832c3bc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:43.906169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0956a0-417c-4c8e-89ad-a17d5832c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:43.906441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0956a0-417c-4c8e-89ad-a17d5832c3bc None admin] PATH_INFO: `/v3/domains/a4b8ffc9450f496b9c23d4cfbfbe4c9c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:43.907611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0956a0-417c-4c8e-89ad-a17d5832c3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=a4b8ffc9450f496b9c23d4cfbfbe4c9c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:43.909057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0956a0-417c-4c8e-89ad-a17d5832c3bc None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:43.911676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 602/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Mon Jun 20 12:05:43 2022] GET /identity/v3/domains/a4b8ffc9450f496b9c23d4cfbfbe4c9c => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:43.916602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:44.013561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2db27-ec8c-4fa1-ad31-e7730e0bb40f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:44.047143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555a359-98e2-45bf-936f-68b847d9a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:44.047805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555a359-98e2-45bf-936f-68b847d9a1dc None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:44.048093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555a359-98e2-45bf-936f-68b847d9a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:44.048371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555a359-98e2-45bf-936f-68b847d9a1dc None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:44.049089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555a359-98e2-45bf-936f-68b847d9a1dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:44.050558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555a359-98e2-45bf-936f-68b847d9a1dc None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:44.175839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 575/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:05:43 2022] POST /identity/v3/users => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:05:46.286234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49b638-0866-4edf-8acf-1a21354d0bb0 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:46.286794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49b638-0866-4edf-8acf-1a21354d0bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:46.286794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49b638-0866-4edf-8acf-1a21354d0bb0 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:46.288155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 603/1178] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:46.293421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:46.293893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:46.293998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:46.310422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:46.311603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:46.357092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:46.375659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 576/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:46.400269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49b638-0866-4edf-8acf-1a21354d0bb0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:46.500220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49b638-0866-4edf-8acf-1a21354d0bb0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:46.532785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:46.533568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:46.533879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:46.534160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:46.545198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:46.552858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:46.555301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:46.556502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 604/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:46.561001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:46.658537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7d64f-77f1-48e6-b1b5-38715addccbc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:46.691781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:46.692467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:46.692753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:46.693033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:46.693777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:46.694120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:46.695582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:46.703442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 577/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:46.709210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:46.748868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:46.808604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8e78d-0adc-4a60-97c4-985c7d3e1961 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:46.841937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:46.842786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:46.843067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:46.843338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] PATH_INFO: `/v3/users/945633f5ba5c4b6f968666559dd35f87` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:46.856919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] RBAC: Authorizing `identity:get_user(user_id=945633f5ba5c4b6f968666559dd35f87)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:46.858375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:46.859987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 605/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:46 2022] GET /identity/v3/users/945633f5ba5c4b6f968666559dd35f87 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:46.865763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:46.911545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:46.965554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1221a-0e21-4b68-b9ff-2291b163d543 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:47.000344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:47.000994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:47.001287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:47.001567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:47.067173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:47.068665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:47.112873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:47.166791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 578/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:05:47.172574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:47.264771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:47.270318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6186a-0264-4160-a657-476d340bcbdc None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:47.304941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a2282-91e1-4518-a018-c396e0ac05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:47.305787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2282-91e1-4518-a018-c396e0ac05b7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:47.306101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2282-91e1-4518-a018-c396e0ac05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:47.306378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a2282-91e1-4518-a018-c396e0ac05b7 None admin] PATH_INFO: `/v3/projects/00fb1867fdf7471ca58c478887deeca2` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:47.307561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a2282-91e1-4518-a018-c396e0ac05b7 None admin] RBAC: Authorizing `identity:get_project(project_id=00fb1867fdf7471ca58c478887deeca2)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:47.309000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a2282-91e1-4518-a018-c396e0ac05b7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:47.310728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 606/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:47 2022] GET /identity/v3/projects/00fb1867fdf7471ca58c478887deeca2 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:47.316771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:47.412915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db4146-7981-45bf-98f7-6aeb990b4532 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:47.447158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:47.447750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:47.448037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:47.448316 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:47.449135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=00fb1867fdf7471ca58c478887deeca2, user.id=945633f5ba5c4b6f968666559dd35f87) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:47.449454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:47.450918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67c3fe-a0fe-4fb6-8a2a-8e3ee161ec06 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:47.456240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 579/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:47 2022] GET /identity/v3/role_assignments?user.id=945633f5ba5c4b6f968666559dd35f87&scope.project.id=00fb1867fdf7471ca58c478887deeca2&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:49.468443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4da74-a802-4f7f-a7e2-1edf3e90c14f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:49.468957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4da74-a802-4f7f-a7e2-1edf3e90c14f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:49.468957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4da74-a802-4f7f-a7e2-1edf3e90c14f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:49.470349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 607/1186] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:49.475443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:49.475865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:49.476004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:49.493221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:49.494428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:49.496327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:49.559825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 580/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:49.582651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4da74-a802-4f7f-a7e2-1edf3e90c14f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:49.683322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4da74-a802-4f7f-a7e2-1edf3e90c14f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:49.716143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:49.716920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:49.717205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:49.717484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:49.728600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:49.736171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:49.737289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:05:49.738212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 608/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:49.743695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:49.841019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ff565-5f48-4ba9-b480-5c471b48a4ec None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:49.875110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:49.875776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:49.876065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:49.876346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:49.877092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:49.877401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:49.878826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:49.883910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:49.887177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 581/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:49.893014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:49.920442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:49.993288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bb14f-7e85-481c-82ce-b6baac5e2e60 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:50.026033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:50.026888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:50.027171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:50.027448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] PATH_INFO: `/v3/users/945633f5ba5c4b6f968666559dd35f87` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:50.028609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] RBAC: Authorizing `identity:get_user(user_id=945633f5ba5c4b6f968666559dd35f87)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:50.030334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:50.031942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 609/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:49 2022] GET /identity/v3/users/945633f5ba5c4b6f968666559dd35f87 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:50.037618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:50.136225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8248c7-d07a-4e94-b132-5606609e392c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:50.169420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409c64a-c575-4aa0-ad1e-f8e3e4635461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:50.170302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c64a-c575-4aa0-ad1e-f8e3e4635461 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:50.170587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c64a-c575-4aa0-ad1e-f8e3e4635461 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:50.170863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409c64a-c575-4aa0-ad1e-f8e3e4635461 None admin] PATH_INFO: `/v3/projects/00fb1867fdf7471ca58c478887deeca2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:50.172050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409c64a-c575-4aa0-ad1e-f8e3e4635461 None admin] RBAC: Authorizing `identity:get_project(project_id=00fb1867fdf7471ca58c478887deeca2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:50.173488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409c64a-c575-4aa0-ad1e-f8e3e4635461 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:50.175208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 582/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:50 2022] GET /identity/v3/projects/00fb1867fdf7471ca58c478887deeca2 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:50.181518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:50.271671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:50.280898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2be85-5fee-48bb-9831-fa278532a3bd None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:50.313471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ec9ab-3927-45ad-bf05-691591f99434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:50.314379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec9ab-3927-45ad-bf05-691591f99434 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:50.314664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec9ab-3927-45ad-bf05-691591f99434 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:50.314939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ec9ab-3927-45ad-bf05-691591f99434 None admin] PATH_INFO: `/v3/projects/00fb1867fdf7471ca58c478887deeca2/users/945633f5ba5c4b6f968666559dd35f87/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:50.316877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec9ab-3927-45ad-bf05-691591f99434 None admin] RBAC: Authorizing `identity:create_grant(project_id=00fb1867fdf7471ca58c478887deeca2, user_id=945633f5ba5c4b6f968666559dd35f87, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:50.318334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ec9ab-3927-45ad-bf05-691591f99434 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:50.396562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 610/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:05:50 2022] PUT /identity/v3/projects/00fb1867fdf7471ca58c478887deeca2/users/945633f5ba5c4b6f968666559dd35f87/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:05:52.401481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7613-cea6-45dc-a0d6-bed48ff4d13b None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:52.402067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7613-cea6-45dc-a0d6-bed48ff4d13b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:52.402067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f7613-cea6-45dc-a0d6-bed48ff4d13b None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:52.403362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 583/1193] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:05:52.408887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:52.409315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:52.409442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:52.426508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:05:52.427685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:05:52.493940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 611/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:05:52.517888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7613-cea6-45dc-a0d6-bed48ff4d13b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:52.584149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:52.618365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f7613-cea6-45dc-a0d6-bed48ff4d13b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:52.659157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:52.659872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:52.660157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:52.660433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:52.671284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:05:52.679662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:05:52.680791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:05:52.682016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 584/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:05:52.687105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:52.767076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:52.785162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755cdb0e-2a23-43c6-873a-970964bbd8bb None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:52.818804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:52.819958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:52.820241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:52.820516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:52.821253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:52.821557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:52.822944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:52.831054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 612/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:52.836906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:52.935087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47530bff-ecac-4c07-bf4a-ade646c6a8ff None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:52.960557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:52.968173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:52.969037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:52.969340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:52.969625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] PATH_INFO: `/v3/users/945633f5ba5c4b6f968666559dd35f87` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:52.970839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=945633f5ba5c4b6f968666559dd35f87)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:52.972275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:52.973923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 585/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jun 20 12:05:52 2022] GET /identity/v3/users/945633f5ba5c4b6f968666559dd35f87 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:52.980009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:53.084284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7aa3a-027e-4c7f-bb84-6b0b1d767308 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:53.117638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:53.118308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:53.118591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:53.118870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:53.133014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:53.184601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:53.186159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:53.282465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 613/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:05:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 12:05:53.288980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:53.386862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a111c2-fbdd-4c35-86b2-296fdc2c1fd5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:53.419678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972f57f-6233-4a1c-a177-43629fb305c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:53.420532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972f57f-6233-4a1c-a177-43629fb305c3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:53.420820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972f57f-6233-4a1c-a177-43629fb305c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:53.421101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972f57f-6233-4a1c-a177-43629fb305c3 None admin] PATH_INFO: `/v3/projects/00fb1867fdf7471ca58c478887deeca2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:53.422295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972f57f-6233-4a1c-a177-43629fb305c3 None admin] RBAC: Authorizing `identity:get_project(project_id=00fb1867fdf7471ca58c478887deeca2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:53.423735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972f57f-6233-4a1c-a177-43629fb305c3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:53.425415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 586/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jun 20 12:05:53 2022] GET /identity/v3/projects/00fb1867fdf7471ca58c478887deeca2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:05:53.432133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:05:53.476177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:05:53.527660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f07a2e-e852-4886-a38d-c87bfe2abe71 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:05:53.561514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:05:53.562181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:05:53.562465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:05:53.562740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:05:53.563560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=00fb1867fdf7471ca58c478887deeca2, user.id=945633f5ba5c4b6f968666559dd35f87) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:05:53.563874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:05:53.565324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbff0a-2e9c-424a-bf2c-00455c3e9b47 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:05:53.571209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 614/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:05:53 2022] GET /identity/v3/role_assignments?user.id=945633f5ba5c4b6f968666559dd35f87&scope.project.id=00fb1867fdf7471ca58c478887deeca2&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:06:03.415647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=68 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:06:03.568417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=46 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:10.966156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbb1f-dc01-46c4-bb12-3cf9bee57437 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:10.966744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbb1f-dc01-46c4-bb12-3cf9bee57437 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:10.966744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cbb1f-dc01-46c4-bb12-3cf9bee57437 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:10.968119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 587/1201] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:10.973660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:10.974134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:10.974242 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:10.991290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:10.992474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:11.061097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 615/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:11.087270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cbb1f-dc01-46c4-bb12-3cf9bee57437 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:11.190276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cbb1f-dc01-46c4-bb12-3cf9bee57437 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:11.222706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:11.223436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:11.223716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:11.223990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:11.234569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:11.236531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:11.255615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:11.256781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:11.258258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:11.258258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:11.258258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:11.258258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:11.258258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 588/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:11.262982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:11.360234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ecc38-2bc8-4372-807a-00f2916fc0b9 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:11.387806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:11.394178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:11.394834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:11.395121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:11.395401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:11.396117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:11.396428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:11.397877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c323628-d1c2-4b5b-813c-cb8826b9f46c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:11.409338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 616/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:11.415084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:11.469476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:11.516020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbda1f-9def-4948-bcf0-006e310e64bf None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:11.550000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c41141-92c3-4d6b-9d16-68705664239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:11.550670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41141-92c3-4d6b-9d16-68705664239d None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:11.550954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41141-92c3-4d6b-9d16-68705664239d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:11.551229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c41141-92c3-4d6b-9d16-68705664239d None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:11.551932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c41141-92c3-4d6b-9d16-68705664239d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:11.553369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c41141-92c3-4d6b-9d16-68705664239d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:11.685289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 589/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jun 20 12:07:11 2022] POST /identity/v3/users => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:13.756408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442125-8e37-4676-bce5-8e1b20478a6e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:13.756962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442125-8e37-4676-bce5-8e1b20478a6e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:13.756962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442125-8e37-4676-bce5-8e1b20478a6e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:13.758399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 617/1206] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:13.763741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:13.764148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:13.764299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:13.782441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:13.783626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:13.850863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 590/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:13.875754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442125-8e37-4676-bce5-8e1b20478a6e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:13.980889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442125-8e37-4676-bce5-8e1b20478a6e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.014413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.015147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.015475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.015837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:14.026181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:14.034836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:14.035895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:14.036805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 618/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:07:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:14.042083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:14.082794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:14.141850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbaac4-7cdd-47e0-acb4-5370930d6c58 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.176199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.176900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.177181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.177453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:14.178220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:14.178525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:14.179891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:14.188294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 591/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:07:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:14.193900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:14.243779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:14.292582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea7660-61eb-48d6-89bf-7c5a1be52b39 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.326226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.327012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.327293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.328138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:14.338405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:14.342013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:14.358862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:14.360048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:14.361023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:14.361023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:14.361023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:14.361023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:14.361023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 619/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:14.366246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:14.464176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:14.467182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6dbaa-0be3-4d16-9a7f-6ecc5377992d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.500530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.501307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.501602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.501913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:14.502635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:14.502948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:14.504393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:14.516464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 592/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:14.522085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:14.620460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd1314-3bff-4080-9261-7f9c9467ef26 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.621915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:14.660190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.660989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.661265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.661537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:14.668349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:14.669778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:07:14.684104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:14.685303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:14.686610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 620/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:14.691781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:14.791583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffb5ea-a127-42d9-bcab-a233338dd9aa None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.826495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.827166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.827453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.827795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:14.828715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:14.829021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:14.830621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:14.848448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 593/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jun 20 12:07:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:14.854287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:14.954635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6253fa-421e-46f2-acb3-a19e00f6e22c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:14.989266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:14.989938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:14.990221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:14.990497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:15.020391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:15.058836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:15.060291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:15.162251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 621/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:07:15.168070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:15.186864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:15.267020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfca30-f216-42f7-8604-b4eb272eb7db None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:15.302136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:15.302925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:15.303213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:15.303495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:15.314357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:15.315847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:15.333823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:15.334908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:15.335836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:15.335836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:15.335836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:15.335836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:15.335836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 594/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:15.340807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:15.400448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:15.437827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d53b2-e5c2-4719-bdfc-b16e3fe02eaf None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:15.471766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:15.472420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:15.472705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:15.472980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:15.473787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:15.474118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:15.475515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:15.486956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 622/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:15.492928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:15.563391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:15.594132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34c822-59f4-48d3-9b9d-989dfa5def26 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:15.627509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:15.628335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:15.628624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:15.628906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:15.635421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:15.641240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:07:15.651195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:15.652255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:15.653400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 595/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:15.658810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:15.758615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ef9a-3319-4237-b7d2-8ed41a818f03 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:15.780596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:15.791643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:15.792301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:15.792585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:15.792863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:15.793640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:15.793987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:15.795421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03f623-07a0-41f1-813a-73d24cc7ff15 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:15.808145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 623/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:15.815238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:15.915464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce537e98-1edf-407e-a65e-b2e140415a91 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:15.947276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:15.953838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:15.954574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:15.954862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:15.955136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:15.955972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=d290657114cf4e8992cba9c10a6c7713) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:15.956285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:15.957717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b94ac-be48-4d01-960e-d2435a9dfc51 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:15.963408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 596/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:15 2022] GET /identity/v3/role_assignments?user.id=d290657114cf4e8992cba9c10a6c7713&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:17.998486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05a28-f799-4b08-936e-14a39889620b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:17.999077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05a28-f799-4b08-936e-14a39889620b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:17.999077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b05a28-f799-4b08-936e-14a39889620b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.000734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 624/1220] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:18.006252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:18.006668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:18.006875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.024271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:18.025449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:18.097796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 597/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:18.120896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05a28-f799-4b08-936e-14a39889620b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:18.231632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b05a28-f799-4b08-936e-14a39889620b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:18.266318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:18.267183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:18.267462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:18.267734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.278089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:18.286882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:18.288129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:18.289463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 625/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:18.294247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:18.394414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1695f9-d038-4a4f-bfb6-51d3a9fa2f82 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:18.417155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:18.427369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:18.428096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:18.428384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:18.428663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.429402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] RBAC: Adding query filter params (name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:18.429718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:18.431141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:18.439749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 598/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:18.445693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:18.488394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:18.543739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371de28f-cbda-4656-a80b-598e4fdaf829 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:18.576135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:18.576928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:18.577219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:18.578170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.589068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:18.590561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:18.607479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:18.608401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:18.609976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:18.609976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:18.609976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:18.609976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:18.609976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 626/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:18.614720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:18.716541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781abed0-dd49-47e9-8a57-f919317b6665 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:18.750155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:18.750812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:18.751099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:18.751380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.752165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:18.752480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:18.753887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:18.766776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 599/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:18.772564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:18.866707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:18.873142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea5421-2d6e-4bba-9302-88dba09ad98f None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:18.907305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:18.908106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:18.908416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:18.908716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:18.916196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:18.919131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:07:18.933674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:18.935996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:18.938178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 627/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:18.941128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:18.988193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:19.040846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74bb9-9c40-4e6c-bb59-3bdb8c406a9f None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:19.076081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:19.076779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:19.077067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:19.077348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:19.078343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:19.078662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:19.080144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:19.098363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 600/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jun 20 12:07:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:19.104176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:19.205299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5adbe-3edf-4fe7-8c99-93ff9b38b866 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:19.238550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:19.239327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:19.239607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:19.239879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:19.251226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:19.252683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:19.269393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:19.270550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:19.271587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:19.271587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:19.271587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:19.271587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:19.271587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 628/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:19.276344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:19.378269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bc8e0-228f-42d1-a242-cb45f43169bb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:19.380554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:19.411565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:19.412225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:19.412527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:19.412788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:19.413501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:19.413827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:19.415213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:19.426918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 601/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:19.432555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:19.442116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:19.529848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226949f-99a0-49d9-b6b0-b834002bcd51 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:19.563076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:19.563868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:19.564155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:19.564436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:19.571186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:19.572669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:07:19.587514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:19.588740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:19.589925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 629/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:19.595469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:19.694975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495b435-7bcd-44ed-add6-1979a8720cc7 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:19.729035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:19.729693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:19.730005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:19.730282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:19.731057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:19.731365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:19.732793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248d7a5-7986-4f64-b9a2-8708d0375cd0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:19.745838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 602/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:19.752441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:19.817664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:19.850518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a5922-d7ff-470e-8e50-daf89551b32d None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:19.883480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4dcfa-4f13-4172-bd3e-890bab724da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:19.884357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4dcfa-4f13-4172-bd3e-890bab724da1 None admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:19.884642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4dcfa-4f13-4172-bd3e-890bab724da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:19.884920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4dcfa-4f13-4172-bd3e-890bab724da1 None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/d290657114cf4e8992cba9c10a6c7713/roles/4ffc82dfa21e464698cd25ba515f1465` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:19.899415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4dcfa-4f13-4172-bd3e-890bab724da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=d290657114cf4e8992cba9c10a6c7713, role_id=4ffc82dfa21e464698cd25ba515f1465)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:19.900974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4dcfa-4f13-4172-bd3e-890bab724da1 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:20.006875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 630/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:07:19 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/d290657114cf4e8992cba9c10a6c7713/roles/4ffc82dfa21e464698cd25ba515f1465 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:07:22.039114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ed8c-5e85-425a-a1c6-017191aa5b9f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.039670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ed8c-5e85-425a-a1c6-017191aa5b9f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.039768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ed8c-5e85-425a-a1c6-017191aa5b9f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.041083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 603/1233] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:22.047363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.047777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.047922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.064709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:22.066045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:22.134537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 631/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:22.158803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3ed8c-5e85-425a-a1c6-017191aa5b9f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:22.184333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.259363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3ed8c-5e85-425a-a1c6-017191aa5b9f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:22.294263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:22.294991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.295275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.295554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.306533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:22.314407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:22.320289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:22.321311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 604/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jun 20 12:07:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:22.322064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:22.368473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.420858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe066f-b896-4906-a870-1c507f321910 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:22.454346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:22.455028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.455313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.455589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.456335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:22.456642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:22.458044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:22.466288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 632/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jun 20 12:07:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:22.473045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:22.559369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.574699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65aad-ddd5-452e-9df9-a031f610dd5b None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:22.607323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:22.609583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.609583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.609583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.618868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:22.620318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:22.636724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:22.638529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:22.639471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:22.639471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:22.639471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:22.639471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:22.639471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 605/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:07:22.644552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:22.744349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3ca13-02cb-43a3-9636-4e7255019f19 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:22.754404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.778934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:22.779935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.780222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.781218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.782060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:22.782374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:22.783830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:22.794995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 633/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:22.800618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:22.900772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e18473-9a9b-45ba-8cfa-47f16e9bdbd6 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:22.933586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:22.934458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:22.934723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:22.935001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:22.938231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:22.943221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:22.944680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:07:22.959546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:22.960732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:22.962143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 606/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:22.966568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:23.065139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6021eb4-a6be-4f64-8102-9d605b1da060 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:23.098818 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:23.099485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:23.099819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:23.100099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:23.100920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:23.101230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:23.102726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:23.119972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 634/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jun 20 12:07:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:23.126305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:23.229009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe39b5-c43d-4ae0-bccc-65481426a372 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:23.263221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca113-8257-456c-ba04-809481239714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:23.270209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca113-8257-456c-ba04-809481239714 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:23.270209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca113-8257-456c-ba04-809481239714 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:23.270209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dca113-8257-456c-ba04-809481239714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:23.324587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:23.331187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca113-8257-456c-ba04-809481239714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:23.332661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dca113-8257-456c-ba04-809481239714 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:23.429375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 607/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:07:23.435270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:23.462188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:23.533273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2063-357e-417c-9d9c-93f7a907c090 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:23.566961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:23.567736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:23.568015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:23.568288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:23.578437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:23.580044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:23.597973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:23.599087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:23.600608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:23.600608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:23.600608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:23.600608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:23.600608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 635/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:23.605041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca113-8257-456c-ba04-809481239714 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:23.697657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:23.703690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dca113-8257-456c-ba04-809481239714 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:23.737476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:23.738161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:23.738445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:23.738724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:23.739436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:23.739742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:23.741113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:23.752452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 608/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:07:23.758239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:23.835779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:23.856377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a4e53-5314-45aa-bfa7-d3224593835a None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:23.888886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:23.889672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:23.890140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:23.890417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:23.897025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:23.898491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:07:23.912839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:23.913968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:23.915380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 636/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:23.920257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:24.023382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fd9e1-0d63-409b-8a28-ccd6e1b4de84 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:24.057118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:24.057773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:24.058091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:24.058370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:24.059149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:24.059460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:24.060891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695494a8-7ea8-4425-b05a-88194aaac5ef None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:24.074445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 609/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:07:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:24.080872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:24.178040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab957e20-9019-4fcf-8467-b18ca0df3489 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:24.210245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:24.210882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:24.211160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:24.211433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:24.212239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] RBAC: Adding query filter params (role.id=4ffc82dfa21e464698cd25ba515f1465, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=d290657114cf4e8992cba9c10a6c7713) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:24.212550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:24.214007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e74f664-7acc-4df0-9cba-8d6a49354154 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:24.219709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 637/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:24 2022] GET /identity/v3/role_assignments?user.id=d290657114cf4e8992cba9c10a6c7713&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=4ffc82dfa21e464698cd25ba515f1465 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:26.317594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438335-944c-4ac9-a807-d58bf14c7947 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:26.318441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438335-944c-4ac9-a807-d58bf14c7947 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:26.318627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438335-944c-4ac9-a807-d58bf14c7947 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:26.320061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 610/1247] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:26.325422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:26.325852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:26.325979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:26.331482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:26.343754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:26.344935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:26.416856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 638/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:26.441826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438335-944c-4ac9-a807-d58bf14c7947 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:26.460285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:26.544004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438335-944c-4ac9-a807-d58bf14c7947 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:26.577301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:26.578342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:26.578629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:26.578904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:26.589942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:26.598345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:26.601927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:26.603047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 611/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:26.605920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:26.704147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0566c-8e77-4141-b295-0440d7f72433 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:26.736234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:26.741325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:26.742022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:26.742307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:26.742582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:26.743324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:26.743630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:26.745055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:26.753557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 639/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:26.759500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:26.838460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:26.862191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2949a9-9535-42de-a37e-13aaaaf046b4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:26.894553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:26.895343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:26.895630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:26.895914 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:26.906928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:26.908399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:26.926286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:26.927361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:26.928375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:26.928375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:26.928375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:26.928375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:26.928375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 612/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:26.933224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:27.034041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743d32d-f862-4fa0-a365-4aa7f322e349 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:27.066429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:27.067089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:27.067373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:27.067714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:27.068490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:27.068797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:27.070187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:27.083213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 640/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:27.088847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:27.187968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702b02a-0b04-4564-b24f-87aabc338445 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:27.213115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:27.220968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:27.221760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:27.222076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:27.222375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:27.229631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:27.231107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:07:27.245568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:27.246617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:27.247635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 613/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:27.253875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:27.309245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:27.352896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868d59e-1ec7-48ca-a7d9-2a3f25c5520b None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:27.387577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:27.388242 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:27.388524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:27.388798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:27.389625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:27.390589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:27.392042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:27.409483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 641/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jun 20 12:07:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:27.415252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:27.515655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddb71c-c63b-487b-9fed-7cb163bf69f4 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:27.548953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:27.549601 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:27.549916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:27.550198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:27.604870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:27.616606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:27.618110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:27.715712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 614/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:07:27.721781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:27.821379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7118428-17ff-46b2-9f5b-e9d907949a63 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:27.835303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:27.856538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:27.857261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:27.857542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:27.857831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:27.867920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:27.869366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:27.887285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:27.888413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:27.890259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:27.890259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:27.890259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:27.890259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:27.890259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 642/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:27.894999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:27.980502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:27.992592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2d2a1-8253-4b7e-9464-b0dcae8774cb None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:28.025058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:28.025713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:28.026019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:28.026296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:28.027006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:28.027311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:28.028684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:28.040644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 615/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:28.047109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:28.148063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e8b7-57bb-44b9-b39e-c70186537105 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:28.183889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:28.184665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:28.184944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:28.185217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:28.192137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:28.193582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:07:28.207332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:28.210398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:28.211562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 643/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:28.214471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:28.315290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02c60-152a-470e-bc2e-a560605f5592 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:28.348538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:28.349193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:28.349476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:28.349752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:28.357390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:28.357390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:28.357390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478c78-5d65-4074-9054-eefce05e2776 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:28.365046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 616/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:07:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:28.371341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:28.397318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:28.472415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38339-5463-4e34-aebf-8f1758d1813c None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:28.505845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:28.506504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:28.506790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:28.507068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:28.507972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=d290657114cf4e8992cba9c10a6c7713) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:28.508205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:28.509634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0c940-96e6-4923-a38a-80236fcef3dd None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:28.515655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 644/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:28 2022] GET /identity/v3/role_assignments?user.id=d290657114cf4e8992cba9c10a6c7713&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=257fc562d022442fb5494f80168760bb => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:30.724571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae67f8-f99f-4d85-a3cd-086486b66282 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:30.725140 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae67f8-f99f-4d85-a3cd-086486b66282 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:30.725140 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae67f8-f99f-4d85-a3cd-086486b66282 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:30.726538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 617/1261] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:30.731858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:30.732267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:30.732411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:30.750296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:30.751485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:30.818027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 645/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:30.840629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae67f8-f99f-4d85-a3cd-086486b66282 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:30.851606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:30.942873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae67f8-f99f-4d85-a3cd-086486b66282 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:30.977398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:30.978158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:30.978447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:30.978725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:30.989227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:30.997060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:30.998248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:30.999954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 618/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:31.005215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:31.024277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:31.107731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c312f0-81f1-4601-85c0-e364aa162206 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:31.141359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:31.142118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:31.142400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:31.142675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:31.143415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:31.143722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:31.145080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:31.152995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 646/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:31.159636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:31.226024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:31.260400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ced6e-2827-470e-84ac-af13a09327d3 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:31.294165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:31.295006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:31.295299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:31.295581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:31.306958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:31.308416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:31.326060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:31.327947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:31.329102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:31.329102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:31.329102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:31.329102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:31.329102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 619/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:31.334027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:31.414702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:31.433925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eaffa-eb56-4593-b17e-ec760cc2cbf0 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:31.467829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:31.468725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:31.469012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:31.469289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:31.470027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:31.470335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:31.471692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:31.483697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 647/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:31.489673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:31.591570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f260d-f976-4a6f-9500-fd0be1a21fe5 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:31.611320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:31.625590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:31.626465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:31.626746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:31.627024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:31.634442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:31.638161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:07:31.650533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:31.651682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:31.652903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 620/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:31.658005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:31.756922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fbc6a-d83d-4dc8-86d9-9c1ba802ff03 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:31.791968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:31.792631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:31.792913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:31.793228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:31.794081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:31.794391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:31.795890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:31.804521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:31.814498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 648/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:31.820239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:31.921305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03833c4-508d-41ca-8b35-d06b787bdbcd None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:31.954514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:31.955304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:31.955589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:31.955863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:31.966247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:31.967830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:31.984903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:31.985997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:31.986947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:31.986947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:31.986947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:31.986947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:31.986947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 621/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:31.991861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:32.095004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239399b9-40e3-4640-8431-1c093d86b103 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:32.128948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:32.129600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:32.129904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:32.130180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:32.131171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:32.131478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:32.132840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:32.145156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 649/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:32.150927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:32.184901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:32.251833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2032f3f-a759-467e-bc1f-3015380606c8 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:32.285015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:32.285835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:32.286122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:32.286404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:32.292908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:32.294411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:07:32.309105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:32.310237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:32.311337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 622/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:32.316914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:32.375952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:32.416766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3c6ef-feee-4a14-993a-cc699d98b634 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:32.450747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:32.451393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:32.451682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:32.452055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:32.452841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:32.453155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:32.454632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181a2c-41eb-4a3f-bed7-937d337ab98b None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:32.466684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 650/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:32.472972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:32.565560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:32.574089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf651663-de04-4d39-bb6f-bf7e30949520 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:32.607731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4ef4-6904-48c5-9f8b-df74793d9800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:32.608613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4ef4-6904-48c5-9f8b-df74793d9800 None admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:32.608896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4ef4-6904-48c5-9f8b-df74793d9800 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:32.609172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4ef4-6904-48c5-9f8b-df74793d9800 None admin] PATH_INFO: `/v3/projects/16580044a8334c4f927c120eeed3ce09/users/d290657114cf4e8992cba9c10a6c7713/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:32.611794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c4ef4-6904-48c5-9f8b-df74793d9800 None admin] RBAC: Authorizing `identity:create_grant(project_id=16580044a8334c4f927c120eeed3ce09, user_id=d290657114cf4e8992cba9c10a6c7713, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:32.613239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c4ef4-6904-48c5-9f8b-df74793d9800 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:32.713292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 623/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jun 20 12:07:32 2022] PUT /identity/v3/projects/16580044a8334c4f927c120eeed3ce09/users/d290657114cf4e8992cba9c10a6c7713/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:07:34.743293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770434-c979-47d2-984c-708370a2f438 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:34.743821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770434-c979-47d2-984c-708370a2f438 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:34.743910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770434-c979-47d2-984c-708370a2f438 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:34.745243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 651/1274] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:34.750468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:34.750891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:34.751027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:34.767285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:34.768695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:34.835504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 624/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:34.860003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770434-c979-47d2-984c-708370a2f438 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:34.962624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770434-c979-47d2-984c-708370a2f438 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:34.980517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:34.997365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:34.998122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:34.998403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:34.998673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.008756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 12:07:35.016455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:35.017597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:35.019012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 652/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jun 20 12:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:35.023993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.109521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:35.127175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d20a83-8b18-46a9-bc68-0557181fe71c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.160840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.161508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.161789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.162095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.162838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:35.163147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:35.164523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:35.172248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 625/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:35.178189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.275473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005338ca-c6fb-4a21-bc66-0ab1f9f02049 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.318258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.319045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.319326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.319599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.329958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:35.332057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:35.350253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:35.351844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:35.353527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:35.353527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:35.353527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:35.353527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:35.353527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 653/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:35.357274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.462708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed72f54-1fb4-4676-a9c3-d0acd70dfbec None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.497311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.498006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.498295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.498577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.499297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:35.499610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:35.500986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:35.513112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 626/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:35.519536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.551349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:35.620399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cd73c-b26a-46de-83df-20aef6684536 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.655113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.655918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.656201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.656477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.664470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:35.666015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 12:07:35.680867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:35.682073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:35.687609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 654/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:07:35.688246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.692299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:35.786150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea338b-3476-4ea5-a448-12e9d8b8314c None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.819037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.819644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.819930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.820206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:35.821031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:35.821354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:35.822810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:35.839502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 627/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:35.845294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:35.935234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:35.944869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fed179-c702-449f-ad0a-e723de9ddd78 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:35.976974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:35.977611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:35.977923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:35.978197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.045038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.046557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.135546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:36.145542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 655/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jun 20 12:07:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 12:07:36.151341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:36.211474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:36.247978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a644510-ba57-46d3-a4e0-712d75dd2f1d None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:36.281538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:36.282367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:36.282658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:36.282942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.293305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.294825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 12:07:36.313324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:36.314462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:36.320311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 12:07:36.320311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 12:07:36.320311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 12:07:36.320311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:36.320311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 628/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:36.320687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:36.421742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411795f-41a0-4737-af11-7c025b1af71e None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:36.456706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:36.457360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:36.457649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:36.457969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.458685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:36.458999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.460369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.471745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 656/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jun 20 12:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:36.477479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:36.578219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727eb1b-7e99-4f36-8803-74de80894a8e None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:36.593104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:36.613754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:36.614568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:36.614846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:36.615117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.621427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.623000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 12:07:36.637920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:36.639014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: ERROR keystone.server.flask.application Jun 20 12:07:36.640211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 629/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jun 20 12:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:36.645114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:36.695104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:36.743512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca5933-d3cf-4abc-bf27-92b81fd00539 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:36.778747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:36.779628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:36.779915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:36.780197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.780993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:36.781308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.782920 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b46dc-ed1c-4eb1-9971-e309c5c10466 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.796857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 657/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jun 20 12:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:36.803089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:36.903030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524243a-eb84-4ff6-b066-fc63aa4654c0 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:36.937321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:36.938103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:36.943076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:36.943076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:36.943076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] RBAC: Adding query filter params (role.id=257fc562d022442fb5494f80168760bb, scope.project.id=16580044a8334c4f927c120eeed3ce09, user.id=d290657114cf4e8992cba9c10a6c7713) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:36.943076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:36.943076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592017c-d4cc-41ff-beba-dc324a6acd01 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:36.947812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 630/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jun 20 12:07:36 2022] GET /identity/v3/role_assignments?user.id=d290657114cf4e8992cba9c10a6c7713&scope.project.id=16580044a8334c4f927c120eeed3ce09&role.id=257fc562d022442fb5494f80168760bb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:39.026626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eba4ee-5f2c-4de4-8fee-4401fbdc737f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:39.027179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eba4ee-5f2c-4de4-8fee-4401fbdc737f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:39.027179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eba4ee-5f2c-4de4-8fee-4401fbdc737f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:39.028623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 658/1288] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:39.034436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:39.034869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:39.034978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:39.052217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:39.053401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:39.083942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:39.120511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 631/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:39.143768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eba4ee-5f2c-4de4-8fee-4401fbdc737f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:39.245423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eba4ee-5f2c-4de4-8fee-4401fbdc737f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:39.256068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:39.278159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:39.278894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:39.279433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:39.279709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] PATH_INFO: `/v3/services/placement` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:39.280362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:39.281751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:39.293982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:39.295788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:39.296763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 659/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:07:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:39.302286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:39.399892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3e325-71c4-4e7d-9f77-8c4995c1245d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:39.434521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:39.435185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:39.435475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:39.435758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:39.436466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:39.436778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:39.438198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cf910-06f4-4090-b9db-fbb115a75bc3 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:39.444012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 632/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jun 20 12:07:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:39.449871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:39.555158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2df22-12e6-441e-98e8-420e659735ba None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:39.589653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:39.590354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:39.590642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:39.590921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] PATH_INFO: `/v3/services` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:39.591632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:39.591946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:39.593335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4882924-103a-4d22-b706-986b468fc2e7 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:39.598473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 660/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jun 20 12:07:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:41.704762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d9d0-9428-44c8-8238-d3c89573526b None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.705301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d9d0-9428-44c8-8238-d3c89573526b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.705301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d9d0-9428-44c8-8238-d3c89573526b None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.706767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 633/1293] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:41.712129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a1fd-4b43-40bf-965a-bea16dec538e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.712536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a1fd-4b43-40bf-965a-bea16dec538e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.712704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4a1fd-4b43-40bf-965a-bea16dec538e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.729635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-15a4a1fd-4b43-40bf-965a-bea16dec538e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:41.730885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-15a4a1fd-4b43-40bf-965a-bea16dec538e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:41.760714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:41.797387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 661/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:41.821308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d9d0-9428-44c8-8238-d3c89573526b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:41.853313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:41.923054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d9d0-9428-44c8-8238-d3c89573526b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:41.956705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cc454-4f21-4fd4-b7e8-b1f6efb619a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:41.957306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc454-4f21-4fd4-b7e8-b1f6efb619a9 None admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:41.957594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc454-4f21-4fd4-b7e8-b1f6efb619a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:41.957905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cc454-4f21-4fd4-b7e8-b1f6efb619a9 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:41.958695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cc454-4f21-4fd4-b7e8-b1f6efb619a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:41.960137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cc454-4f21-4fd4-b7e8-b1f6efb619a9 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:42.090112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 634/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jun 20 12:07:41 2022] POST /identity/v3/services => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:44.135013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5e321-16bb-4663-9b4c-d3b3d4e3778a None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.135525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5e321-16bb-4663-9b4c-d3b3d4e3778a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.135619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5e321-16bb-4663-9b4c-d3b3d4e3778a None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.136993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 662/1296] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:44.142393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.142835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.143129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.159804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:44.160992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:44.233711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 635/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:44.257851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5e321-16bb-4663-9b4c-d3b3d4e3778a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.357430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5e321-16bb-4663-9b4c-d3b3d4e3778a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.390966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.391802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.392084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.392438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.393216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.394615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:44.406641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:44.407851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:44.408813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 663/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 12:07:44.413850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.434200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.516954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf31fc-1964-4be4-9aac-00f162576d8a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.552115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.552770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.553052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.553324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.554044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:44.554351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.555722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.561647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 636/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:44.568298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.600884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.669142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e84ee-2db2-4bb2-b149-236b8630b984 None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.702112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.702762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.703047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.703325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.704111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] RBAC: Adding query filter params (interface=public, service_id=3938b58548224bd5be1de08891a50200, region_id=RegionOne) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:44.704424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.705987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda1b4b-4da5-4b4a-9a02-73fcb3c94aae None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.710966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 664/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/endpoints?service_id=3938b58548224bd5be1de08891a50200&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:44.716598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:44.798166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:44.816572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfceea-9489-4e2e-82f6-d216ed852f02 None admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:44.850460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5126e2-ac86-48ef-9904-fd63a19a8a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:44.851117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5126e2-ac86-48ef-9904-fd63a19a8a29 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:44.851397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5126e2-ac86-48ef-9904-fd63a19a8a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:44.851672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5126e2-ac86-48ef-9904-fd63a19a8a29 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:44.852341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5126e2-ac86-48ef-9904-fd63a19a8a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:44.853707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5126e2-ac86-48ef-9904-fd63a19a8a29 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:44.860289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 637/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jun 20 12:07:44 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:07:46.910387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdfa27-aff0-4588-8d0f-0ebb62cc5051 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:46.910918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdfa27-aff0-4588-8d0f-0ebb62cc5051 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:46.911033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdfa27-aff0-4588-8d0f-0ebb62cc5051 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:46.912362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 665/1302] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:07:46.917599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:46.918041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:46.918278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:46.935218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:07:46.936402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:07:47.003416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 638/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:07:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 12:07:47.028367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdfa27-aff0-4588-8d0f-0ebb62cc5051 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:47.127995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:47.134667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdfa27-aff0-4588-8d0f-0ebb62cc5051 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:47.169069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:47.169828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:47.170111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:47.170389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:47.171041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:47.172422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 12:07:47.184590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 12:07:47.189074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application with Lock( Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self._enter() Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application return self.creator() Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application created_value = creator( Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: ERROR keystone.server.flask.application Jun 20 12:07:47.190412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 666/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jun 20 12:07:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 12:07:47.192189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:47.269002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:47.291663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f77b6b-6fdd-470c-8171-4b31a9357d11 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:47.323775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fae5b-c530-409c-976f-57b018240544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:47.324440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fae5b-c530-409c-976f-57b018240544 None admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:47.324728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fae5b-c530-409c-976f-57b018240544 None admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:47.325009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fae5b-c530-409c-976f-57b018240544 None admin] PATH_INFO: `/v3/services` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:47.325713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fae5b-c530-409c-976f-57b018240544 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:07:47.326055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fae5b-c530-409c-976f-57b018240544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:47.327479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fae5b-c530-409c-976f-57b018240544 None admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:47.333040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 639/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jun 20 12:07:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:07:47.338835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:07:47.437406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f137c-872c-4383-8701-325e0da87ddb None admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:07:47.471125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb3843-a845-4346-ba33-e6bd4f4a59a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:07:47.476210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3843-a845-4346-ba33-e6bd4f4a59a5 None admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:07:47.476210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3843-a845-4346-ba33-e6bd4f4a59a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:07:47.476210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3843-a845-4346-ba33-e6bd4f4a59a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:07:47.476210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3843-a845-4346-ba33-e6bd4f4a59a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:07:47.476210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3843-a845-4346-ba33-e6bd4f4a59a5 None admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:07:47.592549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 667/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jun 20 12:07:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:07:57.375633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=30 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:07:57.587849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:39.117716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfddab-fc19-47a6-9f72-dd0a68904ce0 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:39.118358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfddab-fc19-47a6-9f72-dd0a68904ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:39.118358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfddab-fc19-47a6-9f72-dd0a68904ce0 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:39.126294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f682-6d70-424c-9d54-4a83814aa33d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:39.126889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f682-6d70-424c-9d54-4a83814aa33d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:39.126889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f682-6d70-424c-9d54-4a83814aa33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:39.130630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 640/1307] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:39.224794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3524f682-6d70-424c-9d54-4a83814aa33d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:39.225939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3524f682-6d70-424c-9d54-4a83814aa33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:39.416785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 668/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:14:39.458818 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff8406-eb05-45c5-ac96-021e3052bd75 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:39.459117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff8406-eb05-45c5-ac96-021e3052bd75 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:39.459404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff8406-eb05-45c5-ac96-021e3052bd75 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:39.461410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 641/1309] 10.222.0.64 () {54 vars in 964 bytes} [Mon Jun 20 12:14:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:39.473166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518bcde-1367-44cf-8b89-6f038bf9a072 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:39.473669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518bcde-1367-44cf-8b89-6f038bf9a072 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:39.474060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518bcde-1367-44cf-8b89-6f038bf9a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:39.617554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2518bcde-1367-44cf-8b89-6f038bf9a072 None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:39.619136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2518bcde-1367-44cf-8b89-6f038bf9a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:39.643910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:39.715778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 669/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Mon Jun 20 12:14:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:39.724683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff8406-eb05-45c5-ac96-021e3052bd75 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:39.726541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2dff8406-eb05-45c5-ac96-021e3052bd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:39.843928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff8406-eb05-45c5-ac96-021e3052bd75 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:39.924891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:39.925555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:39.925863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:39.926145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:39.927947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:39.987895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:40.046418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:40.047886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a574b-b8ff-4dcb-97ee-07b0cb050577 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:40.074998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 642/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:14:42.454684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5423-da7a-4856-8dab-3c21c186b2ca None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:42.455228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5423-da7a-4856-8dab-3c21c186b2ca None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:42.455228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea5423-da7a-4856-8dab-3c21c186b2ca None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:42.456636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 670/1312] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:42.461724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939345a4-cfd9-435a-b083-6dc8c0873209 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:42.462171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939345a4-cfd9-435a-b083-6dc8c0873209 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:42.462320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939345a4-cfd9-435a-b083-6dc8c0873209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:42.534329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-939345a4-cfd9-435a-b083-6dc8c0873209 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:42.535562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-939345a4-cfd9-435a-b083-6dc8c0873209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:42.637292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 643/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:42.676065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea5423-da7a-4856-8dab-3c21c186b2ca None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:42.677595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6eea5423-da7a-4856-8dab-3c21c186b2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:42.784109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea5423-da7a-4856-8dab-3c21c186b2ca None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:42.865141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:42.867964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:42.868635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:42.868922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:42.869200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:42.871024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:42.989326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:42.990813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1dd8-ef93-454f-82a4-90cfbed02e9a service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:43.009538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 671/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:14:45.636418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd02f-f3c0-4ea9-81a2-9c369408e1c4 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:45.636959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd02f-f3c0-4ea9-81a2-9c369408e1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:45.637058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bd02f-f3c0-4ea9-81a2-9c369408e1c4 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:45.638400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 644/1315] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:45.643555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41fb7-5e7d-40d4-b7c0-d3147554a3a2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:45.643986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41fb7-5e7d-40d4-b7c0-d3147554a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:45.644169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41fb7-5e7d-40d4-b7c0-d3147554a3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:45.709340 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a1b41fb7-5e7d-40d4-b7c0-d3147554a3a2 None None] MFA Rules not processed for user `b4dabefd3bfb4ca9b3fb0b68b73dfc43`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:45.710572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a1b41fb7-5e7d-40d4-b7c0-d3147554a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:45.764981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:45.809880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 672/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:45.862743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd94b4-7468-417e-afbb-88cff63ccb28 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:45.863041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd94b4-7468-417e-afbb-88cff63ccb28 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:45.863326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd94b4-7468-417e-afbb-88cff63ccb28 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:45.864707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 645/1317] 10.222.0.64 () {54 vars in 964 bytes} [Mon Jun 20 12:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:45.871199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb6fe-d880-4323-b100-4edf7aa82344 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:45.871199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb6fe-d880-4323-b100-4edf7aa82344 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:45.871199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49eb6fe-d880-4323-b100-4edf7aa82344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:45.945023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b49eb6fe-d880-4323-b100-4edf7aa82344 None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:45.946208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b49eb6fe-d880-4323-b100-4edf7aa82344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:46.022381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 673/1318] 10.222.0.64 () {58 vars in 1061 bytes} [Mon Jun 20 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:46.032505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd94b4-7468-417e-afbb-88cff63ccb28 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:46.034067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fcfd94b4-7468-417e-afbb-88cff63ccb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:46.043979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:46.138984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd94b4-7468-417e-afbb-88cff63ccb28 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:46.209668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:46.210269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:46.210555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:46.210832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:46.212911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:46.275359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:46.322044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:46.324207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3ecb4-d952-43d0-a722-02fe1e4b31d7 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:46.341937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 646/1319] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:14:49.555667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80fbee-9322-4360-a3e4-c0627ae1c05e None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:49.556213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80fbee-9322-4360-a3e4-c0627ae1c05e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:49.556213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80fbee-9322-4360-a3e4-c0627ae1c05e None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:49.557718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 674/1320] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:49.563506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9be3-3c0c-4b79-bd18-c35fbfdfef28 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:49.563936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9be3-3c0c-4b79-bd18-c35fbfdfef28 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:49.564093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c9be3-3c0c-4b79-bd18-c35fbfdfef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:49.629081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0a5c9be3-3c0c-4b79-bd18-c35fbfdfef28 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:49.630314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0a5c9be3-3c0c-4b79-bd18-c35fbfdfef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:49.731481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 647/1321] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:49.770127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80fbee-9322-4360-a3e4-c0627ae1c05e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:49.771714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bf80fbee-9322-4360-a3e4-c0627ae1c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:49.822389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:49.875297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80fbee-9322-4360-a3e4-c0627ae1c05e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:49.949030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:49.949682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:49.950017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:49.950320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:49.951985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:50.053087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:50.067865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:50.072326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a6b5e-0246-4fb0-ab74-abe7c23bdb19 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:50.087459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 675/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:14:53.446902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ca67-951e-478c-94c7-a7cc0019eaba None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:53.447423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ca67-951e-478c-94c7-a7cc0019eaba None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:53.447423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38ca67-951e-478c-94c7-a7cc0019eaba None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:53.449982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 648/1323] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:53.455650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7c30a-9eba-41df-b47c-2e5358a39f50 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:53.456217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7c30a-9eba-41df-b47c-2e5358a39f50 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:53.456320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7c30a-9eba-41df-b47c-2e5358a39f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:53.528518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-62f7c30a-9eba-41df-b47c-2e5358a39f50 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:53.529778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-62f7c30a-9eba-41df-b47c-2e5358a39f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:53.636341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 676/1324] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:14:53.672748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ca67-951e-478c-94c7-a7cc0019eaba None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:53.674288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ed38ca67-951e-478c-94c7-a7cc0019eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:53.694082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:53.779629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38ca67-951e-478c-94c7-a7cc0019eaba None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:53.852792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:53.853360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:53.853641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:53.853950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:53.856484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:53.929361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:53.969931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:53.971706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865e64d-2a4c-4be5-8803-2b6967bf99fa service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:53.990566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 649/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:14:56.141275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060ab9-9e28-4031-81d6-6a593603656f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:56.141862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060ab9-9e28-4031-81d6-6a593603656f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:56.141862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3060ab9-9e28-4031-81d6-6a593603656f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:56.143250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 677/1326] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:56.148373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880b842-b077-47aa-81df-cd8bb1d34494 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:56.148787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880b842-b077-47aa-81df-cd8bb1d34494 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:56.149010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880b842-b077-47aa-81df-cd8bb1d34494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:56.214911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7880b842-b077-47aa-81df-cd8bb1d34494 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:56.216137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7880b842-b077-47aa-81df-cd8bb1d34494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:56.314587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 650/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:56.350772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060ab9-9e28-4031-81d6-6a593603656f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:56.352327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b3060ab9-9e28-4031-81d6-6a593603656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:56.416994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:56.461062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3060ab9-9e28-4031-81d6-6a593603656f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:56.535421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:56.536071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:56.536406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:56.536684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:56.538406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:56.655410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:56.657898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:56.659355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361313e-2e4a-4798-aab6-e61e7f74b11f service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:56.677398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 678/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:14:58.798873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e3999-d73a-4d7d-a572-643477d8e0f9 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:58.799474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e3999-d73a-4d7d-a572-643477d8e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:58.799474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e3999-d73a-4d7d-a572-643477d8e0f9 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:58.800810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 651/1329] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:14:58.806117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594221dd-7367-4700-bda8-f101a6f87e69 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:58.806654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594221dd-7367-4700-bda8-f101a6f87e69 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:58.806806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594221dd-7367-4700-bda8-f101a6f87e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:58.873489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-594221dd-7367-4700-bda8-f101a6f87e69 None None] MFA Rules not processed for user `b4dabefd3bfb4ca9b3fb0b68b73dfc43`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:14:58.874743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-594221dd-7367-4700-bda8-f101a6f87e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:58.972813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 679/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:14:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:14:59.010745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e3999-d73a-4d7d-a572-643477d8e0f9 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:14:59.012306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b84e3999-d73a-4d7d-a572-643477d8e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:59.043245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:59.118182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e3999-d73a-4d7d-a572-643477d8e0f9 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:14:59.205895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:14:59.206563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:14:59.206849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:14:59.207108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:14:59.208775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:14:59.303793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:14:59.337629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:14:59.340471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1939b2-28d8-4491-9600-27e972f4a81c service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:14:59.361345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 652/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:14:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:01.944468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2a69-4d5a-42a1-a2d1-151f030cc6cf None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:01.945010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2a69-4d5a-42a1-a2d1-151f030cc6cf None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:01.945010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b2a69-4d5a-42a1-a2d1-151f030cc6cf None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:01.946454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 680/1332] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:01.951880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47e481-c522-42b5-ac68-c1d255772b1c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:01.952303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47e481-c522-42b5-ac68-c1d255772b1c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:01.952446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47e481-c522-42b5-ac68-c1d255772b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:02.017541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-de47e481-c522-42b5-ac68-c1d255772b1c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:02.018794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-de47e481-c522-42b5-ac68-c1d255772b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:02.114716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 653/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:02.150665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b2a69-4d5a-42a1-a2d1-151f030cc6cf None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:02.153210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4c3b2a69-4d5a-42a1-a2d1-151f030cc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:02.222163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:02.255591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b2a69-4d5a-42a1-a2d1-151f030cc6cf None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:02.330309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:02.330967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:02.331254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:02.331532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:02.333215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:02.450481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:02.451925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2bc36-c012-4bfa-a643-95c0d9fe5959 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:02.461555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:02.470217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 681/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:04.537430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2655-49d5-41b6-8d5b-047178871ec6 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:04.537991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2655-49d5-41b6-8d5b-047178871ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:04.538102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2655-49d5-41b6-8d5b-047178871ec6 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:04.539413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 654/1335] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:04.544752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64feb1c-f116-49a9-85db-eed3fc9f4b07 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:04.545166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64feb1c-f116-49a9-85db-eed3fc9f4b07 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:04.545309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64feb1c-f116-49a9-85db-eed3fc9f4b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:04.608910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e64feb1c-f116-49a9-85db-eed3fc9f4b07 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:04.610139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e64feb1c-f116-49a9-85db-eed3fc9f4b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:04.710914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 682/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:04.750964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f2655-49d5-41b6-8d5b-047178871ec6 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:04.752490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cd4f2655-49d5-41b6-8d5b-047178871ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:04.792904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:04.856815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f2655-49d5-41b6-8d5b-047178871ec6 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:04.928426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:04.929074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:04.929357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:04.929633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:04.931298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:05.013667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:05.039190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:05.040647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac04a-f13f-4bca-8609-89c940b2f0aa service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:05.060073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 655/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:15:07.866290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453d24-8ee4-4dd4-8754-1a74f4097d3c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:07.866963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453d24-8ee4-4dd4-8754-1a74f4097d3c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:07.866963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453d24-8ee4-4dd4-8754-1a74f4097d3c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:07.868218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 683/1338] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:07.874259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458c827-f9ce-4375-b838-aafc8547d501 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:07.874766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458c827-f9ce-4375-b838-aafc8547d501 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:07.874880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458c827-f9ce-4375-b838-aafc8547d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:07.941979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b458c827-f9ce-4375-b838-aafc8547d501 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:07.943167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b458c827-f9ce-4375-b838-aafc8547d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:08.038842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 656/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:08.075466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453d24-8ee4-4dd4-8754-1a74f4097d3c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:08.077037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ba453d24-8ee4-4dd4-8754-1a74f4097d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:08.153395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:08.180310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453d24-8ee4-4dd4-8754-1a74f4097d3c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:08.253701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:08.254367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:08.254645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:08.254916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:08.256562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:08.367378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:08.368831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf1e21-1206-4fdd-a92f-76fdb6cfda17 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:08.388271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 684/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:12.771107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cffa9-6898-4b4c-843b-13606035a54b None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:12.771598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cffa9-6898-4b4c-843b-13606035a54b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:12.772201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cffa9-6898-4b4c-843b-13606035a54b None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:12.773169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 657/1341] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:12.779941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676a92-ae0c-46ef-9147-080b149fd393 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:12.780370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676a92-ae0c-46ef-9147-080b149fd393 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:12.780531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20676a92-ae0c-46ef-9147-080b149fd393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:12.786693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:12.856024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-20676a92-ae0c-46ef-9147-080b149fd393 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:12.857336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-20676a92-ae0c-46ef-9147-080b149fd393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:12.976869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 685/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:13.016574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cffa9-6898-4b4c-843b-13606035a54b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:13.018830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-838cffa9-6898-4b4c-843b-13606035a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:13.071511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:13.119539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cffa9-6898-4b4c-843b-13606035a54b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:13.124228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090b5a-a7ca-4c5d-8c91-ef8ebc1949e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:13.124877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090b5a-a7ca-4c5d-8c91-ef8ebc1949e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:13.125165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090b5a-a7ca-4c5d-8c91-ef8ebc1949e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:13.125447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090b5a-a7ca-4c5d-8c91-ef8ebc1949e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:13.134640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090b5a-a7ca-4c5d-8c91-ef8ebc1949e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:13.136178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090b5a-a7ca-4c5d-8c91-ef8ebc1949e6 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:13.145679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 658/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:16.128564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aff94-a0b3-48fb-bb59-dd02d4ec013f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:16.129126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aff94-a0b3-48fb-bb59-dd02d4ec013f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:16.129126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aff94-a0b3-48fb-bb59-dd02d4ec013f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:16.130542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 686/1344] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:16.136253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d18d-cfd0-4928-b362-f2a79b943c5e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:16.136790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d18d-cfd0-4928-b362-f2a79b943c5e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:16.136790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5d18d-cfd0-4928-b362-f2a79b943c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:16.167144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-02b5d18d-cfd0-4928-b362-f2a79b943c5e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:16.168957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-02b5d18d-cfd0-4928-b362-f2a79b943c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:16.249941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 659/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:16.288648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aff94-a0b3-48fb-bb59-dd02d4ec013f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:16.300417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aff94-a0b3-48fb-bb59-dd02d4ec013f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:16.303869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917c8e1-fe28-4a7a-aa41-e7ff8fd0b704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:16.304505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917c8e1-fe28-4a7a-aa41-e7ff8fd0b704 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:16.304786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917c8e1-fe28-4a7a-aa41-e7ff8fd0b704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:16.305062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917c8e1-fe28-4a7a-aa41-e7ff8fd0b704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:16.314310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917c8e1-fe28-4a7a-aa41-e7ff8fd0b704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:16.315740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917c8e1-fe28-4a7a-aa41-e7ff8fd0b704 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:16.325346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 687/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:20.854841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c205a-5bd3-4d33-8618-f75eebfe808c None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:20.855634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c205a-5bd3-4d33-8618-f75eebfe808c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:20.855634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c205a-5bd3-4d33-8618-f75eebfe808c None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:20.857004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 660/1347] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:20.862156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d01a8-c2f5-4e66-af9c-f5b0aba1dc35 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:20.862621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d01a8-c2f5-4e66-af9c-f5b0aba1dc35 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:20.862736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d01a8-c2f5-4e66-af9c-f5b0aba1dc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:20.881886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e35d01a8-c2f5-4e66-af9c-f5b0aba1dc35 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:20.883124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e35d01a8-c2f5-4e66-af9c-f5b0aba1dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:20.894569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 688/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:20.934109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c205a-5bd3-4d33-8618-f75eebfe808c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:20.944732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c205a-5bd3-4d33-8618-f75eebfe808c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:20.948955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43dcd0-f929-4bf9-ba6e-ed6da6df069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:20.949597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dcd0-f929-4bf9-ba6e-ed6da6df069d service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:20.949915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dcd0-f929-4bf9-ba6e-ed6da6df069d service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:20.950195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43dcd0-f929-4bf9-ba6e-ed6da6df069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:20.959909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dcd0-f929-4bf9-ba6e-ed6da6df069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:20.961407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d43dcd0-f929-4bf9-ba6e-ed6da6df069d service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:20.972234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 661/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:25.965148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f7be-4d95-447b-afa2-f9132dd3a7c1 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:25.965670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f7be-4d95-447b-afa2-f9132dd3a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:25.965766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e696f7be-4d95-447b-afa2-f9132dd3a7c1 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:25.967153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 689/1350] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:25.973018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7c541-c20e-46a9-99a7-2c2b23b0c7b8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:25.973462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7c541-c20e-46a9-99a7-2c2b23b0c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:25.973560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7c541-c20e-46a9-99a7-2c2b23b0c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:26.060010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-83f7c541-c20e-46a9-99a7-2c2b23b0c7b8 None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:26.061335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-83f7c541-c20e-46a9-99a7-2c2b23b0c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:26.098187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:26.159402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 662/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:15:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:30.332169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5342b6-fc72-4a32-a57f-bdd9b5493a06 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:30.332693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5342b6-fc72-4a32-a57f-bdd9b5493a06 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:30.332693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5342b6-fc72-4a32-a57f-bdd9b5493a06 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:30.334254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 690/1352] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:30.339447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a5ea-87ce-45ed-b533-d7d942f0927d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:30.340287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a5ea-87ce-45ed-b533-d7d942f0927d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:30.340640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1a5ea-87ce-45ed-b533-d7d942f0927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:30.359402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-daf1a5ea-87ce-45ed-b533-d7d942f0927d None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:30.360612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-daf1a5ea-87ce-45ed-b533-d7d942f0927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:30.372697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 663/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:30.878852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=72 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:32.061442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793327dd-9942-4132-95e5-9008e4e0c694 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:32.062136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793327dd-9942-4132-95e5-9008e4e0c694 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:32.062136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793327dd-9942-4132-95e5-9008e4e0c694 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:32.063430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 691/1354] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:32.068682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2529b2-e270-44ec-bae0-e7010b46e940 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:32.069136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2529b2-e270-44ec-bae0-e7010b46e940 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:32.069266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2529b2-e270-44ec-bae0-e7010b46e940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:32.088407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4b2529b2-e270-44ec-bae0-e7010b46e940 None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:32.089664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4b2529b2-e270-44ec-bae0-e7010b46e940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:32.098357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 664/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:15:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:35.757138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5abdf-6142-4c9a-a13b-32be1a92ee1d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:35.758008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5abdf-6142-4c9a-a13b-32be1a92ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:35.758441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5abdf-6142-4c9a-a13b-32be1a92ee1d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:35.761111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 692/1356] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:35.766625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e006b8-3a33-4893-aaca-e31072bd792e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:35.767443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e006b8-3a33-4893-aaca-e31072bd792e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:35.767896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e006b8-3a33-4893-aaca-e31072bd792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:35.788775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e6e006b8-3a33-4893-aaca-e31072bd792e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:35.790726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e6e006b8-3a33-4893-aaca-e31072bd792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:35.798850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 665/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:35.858749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37501e52-21e5-4fda-8982-eb6664c42716 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:35.859425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37501e52-21e5-4fda-8982-eb6664c42716 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:35.860286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37501e52-21e5-4fda-8982-eb6664c42716 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:35.863217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 693/1358] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jun 20 12:15:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:35.871264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8deb06-6adc-4e32-b090-68b13d14f7bd None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:35.875179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8deb06-6adc-4e32-b090-68b13d14f7bd None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:35.875179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8deb06-6adc-4e32-b090-68b13d14f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:35.928648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9e8deb06-6adc-4e32-b090-68b13d14f7bd None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:35.929899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9e8deb06-6adc-4e32-b090-68b13d14f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:36.039295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 666/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jun 20 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:15:36.050096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37501e52-21e5-4fda-8982-eb6664c42716 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:36.086477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37501e52-21e5-4fda-8982-eb6664c42716 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:36.092450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d2ab9-76a5-4a0e-ba4b-83b6701163e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:36.093317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2ab9-76a5-4a0e-ba4b-83b6701163e3 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:36.093607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2ab9-76a5-4a0e-ba4b-83b6701163e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:36.093977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d2ab9-76a5-4a0e-ba4b-83b6701163e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:36.104558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d2ab9-76a5-4a0e-ba4b-83b6701163e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:36.106234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d2ab9-76a5-4a0e-ba4b-83b6701163e3 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:36.116509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 694/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:38.438631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701885d9-ad8d-4f44-ac4e-845fc2e0d16f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:38.439242 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701885d9-ad8d-4f44-ac4e-845fc2e0d16f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:38.439242 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701885d9-ad8d-4f44-ac4e-845fc2e0d16f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:38.442526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 667/1361] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:38.449500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b7bc2-22f2-42b6-a67e-d1014cc1bd9a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:38.450566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b7bc2-22f2-42b6-a67e-d1014cc1bd9a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:38.450944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b7bc2-22f2-42b6-a67e-d1014cc1bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:38.476204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-300b7bc2-22f2-42b6-a67e-d1014cc1bd9a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:38.477528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-300b7bc2-22f2-42b6-a67e-d1014cc1bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:38.485946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 695/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:38.543945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701885d9-ad8d-4f44-ac4e-845fc2e0d16f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:38.562827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701885d9-ad8d-4f44-ac4e-845fc2e0d16f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:38.571670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16424ea7-86d8-4ccb-9f91-6cb6140cda4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:38.573211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424ea7-86d8-4ccb-9f91-6cb6140cda4f service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:38.573664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424ea7-86d8-4ccb-9f91-6cb6140cda4f service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:38.574156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16424ea7-86d8-4ccb-9f91-6cb6140cda4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:38.585887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16424ea7-86d8-4ccb-9f91-6cb6140cda4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:38.588207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16424ea7-86d8-4ccb-9f91-6cb6140cda4f service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:38.600373 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 668/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:41.221963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760c343-6abf-43d2-a4b8-c014ddb1b445 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:41.222474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760c343-6abf-43d2-a4b8-c014ddb1b445 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:41.222570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760c343-6abf-43d2-a4b8-c014ddb1b445 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:41.224195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 696/1364] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:41.229612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded257a-5a8b-4faf-a6e5-253dc833f638 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:41.230394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded257a-5a8b-4faf-a6e5-253dc833f638 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:41.230830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded257a-5a8b-4faf-a6e5-253dc833f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:41.249112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8ded257a-5a8b-4faf-a6e5-253dc833f638 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:41.250340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8ded257a-5a8b-4faf-a6e5-253dc833f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:41.258455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 669/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:41.307701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9464-8bea-4be8-9e45-311afc500489 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:41.307995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9464-8bea-4be8-9e45-311afc500489 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:41.308278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9464-8bea-4be8-9e45-311afc500489 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:41.309692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 697/1366] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jun 20 12:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:41.315389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6b07-af08-46ed-b8fa-6fea488e351c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:41.315783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6b07-af08-46ed-b8fa-6fea488e351c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:41.316181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb6b07-af08-46ed-b8fa-6fea488e351c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:41.336175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b0eb6b07-af08-46ed-b8fa-6fea488e351c None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:41.339026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b0eb6b07-af08-46ed-b8fa-6fea488e351c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:41.353758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 670/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jun 20 12:15:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:41.371196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9464-8bea-4be8-9e45-311afc500489 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:41.391542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9464-8bea-4be8-9e45-311afc500489 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:41.397708 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0b307-27de-431b-9284-4b882be6055d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:41.398616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0b307-27de-431b-9284-4b882be6055d service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:41.398898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0b307-27de-431b-9284-4b882be6055d service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:41.399165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0b307-27de-431b-9284-4b882be6055d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:41.409106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0b307-27de-431b-9284-4b882be6055d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:41.410727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0b307-27de-431b-9284-4b882be6055d service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:41.420434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 698/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:43.742984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4063-e006-4eb1-a86a-c7826ed79593 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:43.744221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4063-e006-4eb1-a86a-c7826ed79593 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:43.744221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4063-e006-4eb1-a86a-c7826ed79593 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:43.746037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 671/1369] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:43.751302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffca0bc-cafd-4d5e-8e26-9cfbcd5aa52b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:43.751769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffca0bc-cafd-4d5e-8e26-9cfbcd5aa52b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:43.751903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffca0bc-cafd-4d5e-8e26-9cfbcd5aa52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:43.770209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4ffca0bc-cafd-4d5e-8e26-9cfbcd5aa52b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:43.771411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4ffca0bc-cafd-4d5e-8e26-9cfbcd5aa52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:43.779835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 699/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:43.825929 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4063-e006-4eb1-a86a-c7826ed79593 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:43.841123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4063-e006-4eb1-a86a-c7826ed79593 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:43.846955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b9d5f-7eed-450f-b0f2-0d2a306cc459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:43.847764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9d5f-7eed-450f-b0f2-0d2a306cc459 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:43.848275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9d5f-7eed-450f-b0f2-0d2a306cc459 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:43.848623 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9d5f-7eed-450f-b0f2-0d2a306cc459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:43.858492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b9d5f-7eed-450f-b0f2-0d2a306cc459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:43.860360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b9d5f-7eed-450f-b0f2-0d2a306cc459 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:43.871679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 672/1371] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:43.943111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295657f-09bd-4f7c-8e57-81e1d5389863 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:43.943492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295657f-09bd-4f7c-8e57-81e1d5389863 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:43.943773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295657f-09bd-4f7c-8e57-81e1d5389863 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:43.945354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 700/1372] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:43.950880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4ab9-b722-4568-ae24-d825a16ad88c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:43.956366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4ab9-b722-4568-ae24-d825a16ad88c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:43.956366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e4ab9-b722-4568-ae24-d825a16ad88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:43.969675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-088e4ab9-b722-4568-ae24-d825a16ad88c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:43.970909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-088e4ab9-b722-4568-ae24-d825a16ad88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:43.980318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 673/1373] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:44.333933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70590d0d-2c90-46bc-a188-0bb960f877b3 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:44.333933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70590d0d-2c90-46bc-a188-0bb960f877b3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:44.333933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70590d0d-2c90-46bc-a188-0bb960f877b3 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:44.336795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 701/1374] 10.222.0.64 () {54 vars in 963 bytes} [Mon Jun 20 12:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:44.340410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec8c7-2c47-47e3-8ec8-04f7b409f220 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:44.340705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec8c7-2c47-47e3-8ec8-04f7b409f220 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:44.340990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ec8c7-2c47-47e3-8ec8-04f7b409f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:44.348229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:15:44.393317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3b3ec8c7-2c47-47e3-8ec8-04f7b409f220 None None] MFA Rules not processed for user `4761c5c956f84b15a76074531901c462`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:44.394550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3b3ec8c7-2c47-47e3-8ec8-04f7b409f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:44.458190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 674/1375] 10.222.0.64 () {58 vars in 1060 bytes} [Mon Jun 20 12:15:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:44.466324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70590d0d-2c90-46bc-a188-0bb960f877b3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:44.476937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70590d0d-2c90-46bc-a188-0bb960f877b3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:44.480695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495073-4cf7-46b5-83b2-cef1c5c7504e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:44.481335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495073-4cf7-46b5-83b2-cef1c5c7504e service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:44.481618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495073-4cf7-46b5-83b2-cef1c5c7504e service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:44.481931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495073-4cf7-46b5-83b2-cef1c5c7504e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:44.491142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495073-4cf7-46b5-83b2-cef1c5c7504e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:44.492579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495073-4cf7-46b5-83b2-cef1c5c7504e service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:44.502268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 702/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:46.155553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff4e0-f9c1-42cc-9add-bca4237c108f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:46.156110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff4e0-f9c1-42cc-9add-bca4237c108f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:46.156110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ff4e0-f9c1-42cc-9add-bca4237c108f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:46.157481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 675/1377] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:46.162737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225e5c-a230-47d8-9080-c255394a6170 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:46.163184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225e5c-a230-47d8-9080-c255394a6170 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:46.163294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74225e5c-a230-47d8-9080-c255394a6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:46.180885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-74225e5c-a230-47d8-9080-c255394a6170 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:46.187931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-74225e5c-a230-47d8-9080-c255394a6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:46.190100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 703/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:46.235209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ff4e0-f9c1-42cc-9add-bca4237c108f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:46.250015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ff4e0-f9c1-42cc-9add-bca4237c108f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:46.255457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4ca22-845c-4986-9caf-41bd63622f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:46.256033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ca22-845c-4986-9caf-41bd63622f22 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:46.256318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ca22-845c-4986-9caf-41bd63622f22 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:46.256598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4ca22-845c-4986-9caf-41bd63622f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:46.265857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ca22-845c-4986-9caf-41bd63622f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:46.267484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d4ca22-845c-4986-9caf-41bd63622f22 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:46.277423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 676/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:48.546074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252594af-ee1d-4d94-899f-fec3e7c927cf None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:48.546936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252594af-ee1d-4d94-899f-fec3e7c927cf None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:48.547396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252594af-ee1d-4d94-899f-fec3e7c927cf None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:48.548950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 704/1380] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:48.554411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679ca37-18c4-4de7-a9ac-8352c5f3d22b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:48.554839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679ca37-18c4-4de7-a9ac-8352c5f3d22b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:48.554977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679ca37-18c4-4de7-a9ac-8352c5f3d22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:48.574106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3679ca37-18c4-4de7-a9ac-8352c5f3d22b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:48.575652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3679ca37-18c4-4de7-a9ac-8352c5f3d22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:48.583949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 677/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:48.628930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252594af-ee1d-4d94-899f-fec3e7c927cf None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:48.645161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252594af-ee1d-4d94-899f-fec3e7c927cf None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:48.651849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204adc56-c131-41bf-82e4-416bb0f35b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:48.652619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204adc56-c131-41bf-82e4-416bb0f35b30 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:48.653269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204adc56-c131-41bf-82e4-416bb0f35b30 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:48.653669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204adc56-c131-41bf-82e4-416bb0f35b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:48.663072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204adc56-c131-41bf-82e4-416bb0f35b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:48.666820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204adc56-c131-41bf-82e4-416bb0f35b30 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:48.679099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 705/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:50.932062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2bdf0-1c50-454b-828b-effcff97bfb4 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:50.932997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2bdf0-1c50-454b-828b-effcff97bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:50.933387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2bdf0-1c50-454b-828b-effcff97bfb4 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:50.935290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 678/1383] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:50.940347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b776-98a9-43b7-a3da-23d25119da10 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:50.940793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b776-98a9-43b7-a3da-23d25119da10 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:50.940877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851b776-98a9-43b7-a3da-23d25119da10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:50.959547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6851b776-98a9-43b7-a3da-23d25119da10 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:50.960739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6851b776-98a9-43b7-a3da-23d25119da10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:50.969159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 706/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:51.011701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2bdf0-1c50-454b-828b-effcff97bfb4 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:51.027061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2bdf0-1c50-454b-828b-effcff97bfb4 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:51.033558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e702e0-f47a-43c2-aa12-b32827b5e9bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:51.034564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e702e0-f47a-43c2-aa12-b32827b5e9bc service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:51.035102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e702e0-f47a-43c2-aa12-b32827b5e9bc service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:51.035608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e702e0-f47a-43c2-aa12-b32827b5e9bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:51.044976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e702e0-f47a-43c2-aa12-b32827b5e9bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:51.046895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e702e0-f47a-43c2-aa12-b32827b5e9bc service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:51.058276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 679/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:53.154667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610d1b7-d34e-4ef5-9c4a-43681e3c3e2b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:53.155227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610d1b7-d34e-4ef5-9c4a-43681e3c3e2b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:53.155431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610d1b7-d34e-4ef5-9c4a-43681e3c3e2b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:53.157181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 707/1386] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:53.162925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8af40-164d-4de8-8edd-77bdd102da34 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:53.163341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8af40-164d-4de8-8edd-77bdd102da34 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:53.163626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8af40-164d-4de8-8edd-77bdd102da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:53.186817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d3a8af40-164d-4de8-8edd-77bdd102da34 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:53.188841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d3a8af40-164d-4de8-8edd-77bdd102da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:53.199606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 680/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:53.244826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610d1b7-d34e-4ef5-9c4a-43681e3c3e2b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:53.264110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610d1b7-d34e-4ef5-9c4a-43681e3c3e2b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:53.270971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eadf68-1428-4169-bbd3-3f25f88ef81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:53.271821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf68-1428-4169-bbd3-3f25f88ef81e service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:53.272114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf68-1428-4169-bbd3-3f25f88ef81e service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:53.272522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eadf68-1428-4169-bbd3-3f25f88ef81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:53.283875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eadf68-1428-4169-bbd3-3f25f88ef81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:53.286241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eadf68-1428-4169-bbd3-3f25f88ef81e service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:53.298915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 708/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:55.646441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dd788-26a0-49e9-8b7c-8b03bbb0fba9 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:55.647026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dd788-26a0-49e9-8b7c-8b03bbb0fba9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:55.647399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dd788-26a0-49e9-8b7c-8b03bbb0fba9 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:55.650416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 681/1389] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:55.656650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f57ba-0622-4f69-8443-533d05046613 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:55.657113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f57ba-0622-4f69-8443-533d05046613 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:55.657359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f57ba-0622-4f69-8443-533d05046613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:55.679582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c02f57ba-0622-4f69-8443-533d05046613 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:55.681376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c02f57ba-0622-4f69-8443-533d05046613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:55.691667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 709/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:55.746087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dd788-26a0-49e9-8b7c-8b03bbb0fba9 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:55.761041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dd788-26a0-49e9-8b7c-8b03bbb0fba9 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:55.766701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bc51-f861-47ee-a9f3-e7300a06a28a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:55.767344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bc51-f861-47ee-a9f3-e7300a06a28a service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:55.767631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bc51-f861-47ee-a9f3-e7300a06a28a service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:55.767909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bc51-f861-47ee-a9f3-e7300a06a28a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:55.777156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07bc51-f861-47ee-a9f3-e7300a06a28a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:55.779045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07bc51-f861-47ee-a9f3-e7300a06a28a service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:55.788762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 682/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:15:58.406133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959425f-d993-48ae-9a73-1685deab2262 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:58.406665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959425f-d993-48ae-9a73-1685deab2262 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:58.406665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959425f-d993-48ae-9a73-1685deab2262 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:58.408010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 710/1392] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:15:58.413316 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e02f-c702-4e2b-a57e-ac01adc5499c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:58.413745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e02f-c702-4e2b-a57e-ac01adc5499c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:58.413953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e02f-c702-4e2b-a57e-ac01adc5499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:58.433224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c744e02f-c702-4e2b-a57e-ac01adc5499c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:15:58.434464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c744e02f-c702-4e2b-a57e-ac01adc5499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:15:58.442295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 683/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:15:58.487402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959425f-d993-48ae-9a73-1685deab2262 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:15:58.502202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959425f-d993-48ae-9a73-1685deab2262 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:15:58.507714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc780cf-9388-47d8-96a6-c451762d1ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:15:58.508359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc780cf-9388-47d8-96a6-c451762d1ab9 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:15:58.508681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc780cf-9388-47d8-96a6-c451762d1ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:15:58.508971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc780cf-9388-47d8-96a6-c451762d1ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:15:58.517449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc780cf-9388-47d8-96a6-c451762d1ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:15:58.519105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc780cf-9388-47d8-96a6-c451762d1ab9 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:15:58.529670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 711/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:00.136246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051fa85-c15e-47a1-802b-23d9802fd3e0 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.136865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051fa85-c15e-47a1-802b-23d9802fd3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.136865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051fa85-c15e-47a1-802b-23d9802fd3e0 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.138238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 684/1395] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:00.143597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37433bf-4400-4262-8c09-f2e296dc1b5f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.144025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37433bf-4400-4262-8c09-f2e296dc1b5f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.144188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37433bf-4400-4262-8c09-f2e296dc1b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.162175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e37433bf-4400-4262-8c09-f2e296dc1b5f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:00.163382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e37433bf-4400-4262-8c09-f2e296dc1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:00.172405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 712/1396] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:00.228743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1ed88-0a3b-407d-b79b-3a0a26922bd2 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.229139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1ed88-0a3b-407d-b79b-3a0a26922bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.229518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1ed88-0a3b-407d-b79b-3a0a26922bd2 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.231004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 685/1397] 10.222.0.64 () {54 vars in 962 bytes} [Mon Jun 20 12:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:00.236308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a22e0-2498-4b08-8809-bcdd3be0b884 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.236602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a22e0-2498-4b08-8809-bcdd3be0b884 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.236885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a22e0-2498-4b08-8809-bcdd3be0b884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.286260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-349a22e0-2498-4b08-8809-bcdd3be0b884 None None] MFA Rules not processed for user `a20f362695fa4fbdb685632d4369bf04`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:00.287485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-349a22e0-2498-4b08-8809-bcdd3be0b884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:00.349305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 713/1398] 10.222.0.64 () {58 vars in 1059 bytes} [Mon Jun 20 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:00.357641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1ed88-0a3b-407d-b79b-3a0a26922bd2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:00.368607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1ed88-0a3b-407d-b79b-3a0a26922bd2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:00.372634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689b00-3d56-43ae-b5c2-a1a78e2ea7f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:00.373264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689b00-3d56-43ae-b5c2-a1a78e2ea7f2 service glance] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.373543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689b00-3d56-43ae-b5c2-a1a78e2ea7f2 service glance] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.373845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689b00-3d56-43ae-b5c2-a1a78e2ea7f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.382850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689b00-3d56-43ae-b5c2-a1a78e2ea7f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:00.384352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689b00-3d56-43ae-b5c2-a1a78e2ea7f2 service glance] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:00.394379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 686/1399] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:00.759010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5a584-a03d-4b12-b650-413c5a2f8493 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.759230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5a584-a03d-4b12-b650-413c5a2f8493 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.759505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5a584-a03d-4b12-b650-413c5a2f8493 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.760987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 714/1400] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:00.766437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b98083-dbfa-40e9-ab69-d37266e93159 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.766749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b98083-dbfa-40e9-ab69-d37266e93159 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.767081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b98083-dbfa-40e9-ab69-d37266e93159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.785769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f7b98083-dbfa-40e9-ab69-d37266e93159 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:00.786994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f7b98083-dbfa-40e9-ab69-d37266e93159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:00.796450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 687/1401] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:00.844007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5a584-a03d-4b12-b650-413c5a2f8493 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:00.859712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5a584-a03d-4b12-b650-413c5a2f8493 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:00.865309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80649fc4-0bda-417d-bbdd-924a4a932c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:00.865995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80649fc4-0bda-417d-bbdd-924a4a932c96 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:00.866272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80649fc4-0bda-417d-bbdd-924a4a932c96 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:00.866533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80649fc4-0bda-417d-bbdd-924a4a932c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:00.875938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80649fc4-0bda-417d-bbdd-924a4a932c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:00.878567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80649fc4-0bda-417d-bbdd-924a4a932c96 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:00.891809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 715/1402] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:01.313040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1d5da-9a26-41c2-a0b7-4305e79d0550 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:01.313535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1d5da-9a26-41c2-a0b7-4305e79d0550 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:01.313642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1d5da-9a26-41c2-a0b7-4305e79d0550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:01.361885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-eaf1d5da-9a26-41c2-a0b7-4305e79d0550 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:01.363076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-eaf1d5da-9a26-41c2-a0b7-4305e79d0550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:01.397511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:01.430037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 688/1403] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:01.471939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17bb8-3dc2-43fb-8ad2-0179c4710e50 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:01.472437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17bb8-3dc2-43fb-8ad2-0179c4710e50 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:01.472551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa17bb8-3dc2-43fb-8ad2-0179c4710e50 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:01.473942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 716/1404] 10.222.0.64 () {54 vars in 942 bytes} [Mon Jun 20 12:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:01.480725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823e6d-7396-4fad-bb53-c35b6fa76ea5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:01.481119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823e6d-7396-4fad-bb53-c35b6fa76ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:01.481476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56823e6d-7396-4fad-bb53-c35b6fa76ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:01.531451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-56823e6d-7396-4fad-bb53-c35b6fa76ea5 None None] MFA Rules not processed for user `5c26b297875b47bf8b14775b4fb63c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:01.532648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-56823e6d-7396-4fad-bb53-c35b6fa76ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:01.604642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 689/1405] 10.222.0.64 () {58 vars in 1039 bytes} [Mon Jun 20 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:01.614110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa17bb8-3dc2-43fb-8ad2-0179c4710e50 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:01.627158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:01.634163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa17bb8-3dc2-43fb-8ad2-0179c4710e50 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:01.638931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b83da-9d94-4d51-87c1-e71ec708d767 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:01.639585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b83da-9d94-4d51-87c1-e71ec708d767 service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:01.639872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b83da-9d94-4d51-87c1-e71ec708d767 service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:01.640174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b83da-9d94-4d51-87c1-e71ec708d767 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:01.648883 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b83da-9d94-4d51-87c1-e71ec708d767 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:01.651917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b83da-9d94-4d51-87c1-e71ec708d767 service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:01.659165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 717/1406] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:16:03.152243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39432c-0c19-49ef-bbbc-68352014fdfe None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:03.153151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39432c-0c19-49ef-bbbc-68352014fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:03.153151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39432c-0c19-49ef-bbbc-68352014fdfe None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:03.154903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 690/1407] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:16:03.160439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854fe5-e8f6-4053-acc3-74abd26e5391 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:03.160922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854fe5-e8f6-4053-acc3-74abd26e5391 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:03.161106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854fe5-e8f6-4053-acc3-74abd26e5391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:03.185600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-55854fe5-e8f6-4053-acc3-74abd26e5391 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:03.187063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-55854fe5-e8f6-4053-acc3-74abd26e5391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:03.196455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 718/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:03.249280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39432c-0c19-49ef-bbbc-68352014fdfe None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:03.264945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39432c-0c19-49ef-bbbc-68352014fdfe None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:03.270655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d379ccb-c68e-4390-9ebe-d7f028f5e54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:03.271294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379ccb-c68e-4390-9ebe-d7f028f5e54e service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:03.271580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379ccb-c68e-4390-9ebe-d7f028f5e54e service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:03.271859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d379ccb-c68e-4390-9ebe-d7f028f5e54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:03.282380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d379ccb-c68e-4390-9ebe-d7f028f5e54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:03.284652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d379ccb-c68e-4390-9ebe-d7f028f5e54e service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:03.295959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 691/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:13.176273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=8 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:13.290757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=62 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:25.874205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad25a2-53d4-4dea-a0c2-a146e038d901 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:25.874822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad25a2-53d4-4dea-a0c2-a146e038d901 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:25.874822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad25a2-53d4-4dea-a0c2-a146e038d901 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:25.876137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 719/1410] 10.222.0.64 () {54 vars in 918 bytes} [Mon Jun 20 12:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:25.881279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536b442-aebe-466d-84cb-c3cb210d19d9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:25.881738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536b442-aebe-466d-84cb-c3cb210d19d9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:25.881870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536b442-aebe-466d-84cb-c3cb210d19d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:25.900628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2536b442-aebe-466d-84cb-c3cb210d19d9 None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:25.901833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2536b442-aebe-466d-84cb-c3cb210d19d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:25.910492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 692/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Mon Jun 20 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:25.925189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eea33-7cdc-49cf-b903-ec9caaea9cbe None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:25.925478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eea33-7cdc-49cf-b903-ec9caaea9cbe None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:25.925758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eea33-7cdc-49cf-b903-ec9caaea9cbe None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:25.927147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 720/1412] 10.222.0.64 () {54 vars in 918 bytes} [Mon Jun 20 12:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:25.931925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26aa11-264a-4bcf-b328-c325fdb03c68 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:25.932249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26aa11-264a-4bcf-b328-c325fdb03c68 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:25.932534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26aa11-264a-4bcf-b328-c325fdb03c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:25.950617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-5f26aa11-264a-4bcf-b328-c325fdb03c68 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:25.951805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5f26aa11-264a-4bcf-b328-c325fdb03c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:25.961478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 693/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Mon Jun 20 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:28.468600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0005-cbfd-48c0-931c-5e3f5fbbeb3d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:28.469114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0005-cbfd-48c0-931c-5e3f5fbbeb3d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:28.469114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af0005-cbfd-48c0-931c-5e3f5fbbeb3d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:28.470533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:28.475708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0936-6d10-4f7f-b06e-7a9892b2bc05 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:28.476126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0936-6d10-4f7f-b06e-7a9892b2bc05 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:28.476952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0936-6d10-4f7f-b06e-7a9892b2bc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:28.494566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b58f0936-6d10-4f7f-b06e-7a9892b2bc05 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:28.495768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b58f0936-6d10-4f7f-b06e-7a9892b2bc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:28.503866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:28.547771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af0005-cbfd-48c0-931c-5e3f5fbbeb3d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:28.562534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af0005-cbfd-48c0-931c-5e3f5fbbeb3d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:28.567879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccefc1-1597-49b9-93d7-ab886927c36f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:28.568513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccefc1-1597-49b9-93d7-ab886927c36f service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:28.568794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccefc1-1597-49b9-93d7-ab886927c36f service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:28.569068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccefc1-1597-49b9-93d7-ab886927c36f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:28.577472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccefc1-1597-49b9-93d7-ab886927c36f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:28.579121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccefc1-1597-49b9-93d7-ab886927c36f service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:28.589326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 722/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:29.490620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5187e-b6ec-46f1-9206-aaf696378d20 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:29.491148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5187e-b6ec-46f1-9206-aaf696378d20 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:29.491148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5187e-b6ec-46f1-9206-aaf696378d20 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:29.493089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:29.498212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8099-ef43-4139-8388-671368e64614 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:29.498630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8099-ef43-4139-8388-671368e64614 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:29.498774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b8099-ef43-4139-8388-671368e64614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:29.516938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-854b8099-ef43-4139-8388-671368e64614 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:29.518197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-854b8099-ef43-4139-8388-671368e64614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:29.526280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:29.680604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5187e-b6ec-46f1-9206-aaf696378d20 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:29.695471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5187e-b6ec-46f1-9206-aaf696378d20 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:29.700742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68d4f-85f6-49f7-b555-6a31cd9130bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:29.701369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68d4f-85f6-49f7-b555-6a31cd9130bd service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:29.701648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68d4f-85f6-49f7-b555-6a31cd9130bd service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:29.701957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68d4f-85f6-49f7-b555-6a31cd9130bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:29.710042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68d4f-85f6-49f7-b555-6a31cd9130bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:29.712257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68d4f-85f6-49f7-b555-6a31cd9130bd service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:29.721485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 696/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:30.604203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24757a8-0903-460d-9aaa-b39e20151d52 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:30.604752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24757a8-0903-460d-9aaa-b39e20151d52 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:30.604852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24757a8-0903-460d-9aaa-b39e20151d52 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:30.606258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:30.611311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f882-e07f-43cd-9a02-76597e3de5b9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:30.611717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f882-e07f-43cd-9a02-76597e3de5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:30.611869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f882-e07f-43cd-9a02-76597e3de5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:30.629553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e692f882-e07f-43cd-9a02-76597e3de5b9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:30.630764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e692f882-e07f-43cd-9a02-76597e3de5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:30.638864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:30.791794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24757a8-0903-460d-9aaa-b39e20151d52 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:30.806141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24757a8-0903-460d-9aaa-b39e20151d52 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:30.811499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67a13-86a9-4bdf-bfca-a3260dcb5747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:30.812126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67a13-86a9-4bdf-bfca-a3260dcb5747 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:30.812405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67a13-86a9-4bdf-bfca-a3260dcb5747 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:30.812679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67a13-86a9-4bdf-bfca-a3260dcb5747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:30.821016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b67a13-86a9-4bdf-bfca-a3260dcb5747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:30.822648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b67a13-86a9-4bdf-bfca-a3260dcb5747 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:30.831852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 725/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:31.713178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665739a-1401-416f-b4b5-1ec9a62c72b4 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:31.713757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665739a-1401-416f-b4b5-1ec9a62c72b4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:31.713757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665739a-1401-416f-b4b5-1ec9a62c72b4 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:31.715146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:16:31.720093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0061-c8b9-4c5a-bc5c-140beb4dd0cb None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:31.720500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0061-c8b9-4c5a-bc5c-140beb4dd0cb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:31.720663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce0061-c8b9-4c5a-bc5c-140beb4dd0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:31.738550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-81ce0061-c8b9-4c5a-bc5c-140beb4dd0cb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:31.739787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-81ce0061-c8b9-4c5a-bc5c-140beb4dd0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:31.747767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:31.901011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665739a-1401-416f-b4b5-1ec9a62c72b4 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:31.915833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665739a-1401-416f-b4b5-1ec9a62c72b4 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:31.921319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e67fc-808a-4170-87f4-7bd822228229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:31.921989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e67fc-808a-4170-87f4-7bd822228229 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:31.922274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e67fc-808a-4170-87f4-7bd822228229 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:31.922562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e67fc-808a-4170-87f4-7bd822228229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:31.930575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e67fc-808a-4170-87f4-7bd822228229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:31.932312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e67fc-808a-4170-87f4-7bd822228229 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:31.941641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 699/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:32.805619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44fef8-24be-4cd0-9a89-a3f3278a092c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:32.806196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44fef8-24be-4cd0-9a89-a3f3278a092c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:32.806196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44fef8-24be-4cd0-9a89-a3f3278a092c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:32.807608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:32.812882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647170ca-b343-43b3-aa20-9837fbe0f2d9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:32.814318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647170ca-b343-43b3-aa20-9837fbe0f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:32.814318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647170ca-b343-43b3-aa20-9837fbe0f2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:32.832118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-647170ca-b343-43b3-aa20-9837fbe0f2d9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:32.833314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-647170ca-b343-43b3-aa20-9837fbe0f2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:32.841650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:32.991885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44fef8-24be-4cd0-9a89-a3f3278a092c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:33.006534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44fef8-24be-4cd0-9a89-a3f3278a092c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:33.012090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f749b2ca-b63c-499a-8dc3-644e8d1fbdf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:33.012719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b2ca-b63c-499a-8dc3-644e8d1fbdf6 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:33.013005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b2ca-b63c-499a-8dc3-644e8d1fbdf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:33.013285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f749b2ca-b63c-499a-8dc3-644e8d1fbdf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:33.021405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749b2ca-b63c-499a-8dc3-644e8d1fbdf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:33.023589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f749b2ca-b63c-499a-8dc3-644e8d1fbdf6 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:33.033258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 728/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:33.908413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10cbab-2753-47be-8b08-02cc96cfddff None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:33.908988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10cbab-2753-47be-8b08-02cc96cfddff None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:33.908988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10cbab-2753-47be-8b08-02cc96cfddff None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:33.910367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:33.915463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c877685-7e0b-4391-9e89-cf05524b45ce None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:33.915897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c877685-7e0b-4391-9e89-cf05524b45ce None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:33.916076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c877685-7e0b-4391-9e89-cf05524b45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:33.934966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2c877685-7e0b-4391-9e89-cf05524b45ce None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:33.936168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2c877685-7e0b-4391-9e89-cf05524b45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:33.943969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:34.097995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10cbab-2753-47be-8b08-02cc96cfddff None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:34.112469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10cbab-2753-47be-8b08-02cc96cfddff None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:34.117960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44685685-96e9-4829-b370-cbd3a15e484d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:34.118586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685685-96e9-4829-b370-cbd3a15e484d service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:34.118866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685685-96e9-4829-b370-cbd3a15e484d service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:34.119142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44685685-96e9-4829-b370-cbd3a15e484d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:34.127155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44685685-96e9-4829-b370-cbd3a15e484d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:34.128760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44685685-96e9-4829-b370-cbd3a15e484d service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:34.138755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 702/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:35.017176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ccff-8beb-4e94-a951-960cdcfba13f None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:35.017726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ccff-8beb-4e94-a951-960cdcfba13f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:35.017726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ccff-8beb-4e94-a951-960cdcfba13f None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:35.019147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:35.024500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8d41a-35e9-430e-bd68-f46d022efa3c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:35.024948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8d41a-35e9-430e-bd68-f46d022efa3c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:35.025062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8d41a-35e9-430e-bd68-f46d022efa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:35.044213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-cfb8d41a-35e9-430e-bd68-f46d022efa3c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:35.045404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cfb8d41a-35e9-430e-bd68-f46d022efa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:35.053155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:35.216033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ccff-8beb-4e94-a951-960cdcfba13f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:35.231059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ccff-8beb-4e94-a951-960cdcfba13f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:35.236478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a120c-5a15-4115-a293-f9e32192f7db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:35.237110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a120c-5a15-4115-a293-f9e32192f7db service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:35.237393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a120c-5a15-4115-a293-f9e32192f7db service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:35.237668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a120c-5a15-4115-a293-f9e32192f7db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:35.246162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a120c-5a15-4115-a293-f9e32192f7db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:35.247783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a120c-5a15-4115-a293-f9e32192f7db service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:35.257146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 731/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:36.156619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b63b5-af8f-41a5-9c06-0301a71b1d8b None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:36.157147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b63b5-af8f-41a5-9c06-0301a71b1d8b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:36.157271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b63b5-af8f-41a5-9c06-0301a71b1d8b None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:36.158577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:36.163421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a246-e33b-4e52-82ac-2379e978dd81 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:36.163825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a246-e33b-4e52-82ac-2379e978dd81 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:36.163979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964a246-e33b-4e52-82ac-2379e978dd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:36.182621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6964a246-e33b-4e52-82ac-2379e978dd81 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:36.183808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6964a246-e33b-4e52-82ac-2379e978dd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:36.191637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:36.343192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b63b5-af8f-41a5-9c06-0301a71b1d8b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:36.357345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b63b5-af8f-41a5-9c06-0301a71b1d8b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:36.362697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef871f7-93a0-487f-bdea-1d3f1888ed01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:36.363330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef871f7-93a0-487f-bdea-1d3f1888ed01 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:36.363614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef871f7-93a0-487f-bdea-1d3f1888ed01 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:36.363889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef871f7-93a0-487f-bdea-1d3f1888ed01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:36.372320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef871f7-93a0-487f-bdea-1d3f1888ed01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:36.373947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef871f7-93a0-487f-bdea-1d3f1888ed01 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:36.383141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 705/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:37.280394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f949-216c-4a9f-ae63-147ad9e84a4b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:37.280836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f949-216c-4a9f-ae63-147ad9e84a4b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:37.280984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f949-216c-4a9f-ae63-147ad9e84a4b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:37.282430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:37.287307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c42f-8262-418b-bcfc-2fe5a9979bc9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:37.287723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c42f-8262-418b-bcfc-2fe5a9979bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:37.287857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c42f-8262-418b-bcfc-2fe5a9979bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:37.306507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-83c3c42f-8262-418b-bcfc-2fe5a9979bc9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:37.307690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-83c3c42f-8262-418b-bcfc-2fe5a9979bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:37.315400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:37.466310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28f949-216c-4a9f-ae63-147ad9e84a4b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:37.480802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28f949-216c-4a9f-ae63-147ad9e84a4b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:37.486212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1278df7-0420-4817-a0f1-8f0f6038af21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:37.486872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1278df7-0420-4817-a0f1-8f0f6038af21 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:37.487159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1278df7-0420-4817-a0f1-8f0f6038af21 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:37.487440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1278df7-0420-4817-a0f1-8f0f6038af21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:37.496207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1278df7-0420-4817-a0f1-8f0f6038af21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:37.497834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1278df7-0420-4817-a0f1-8f0f6038af21 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:37.507665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 734/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:39.526884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02358-ee5b-4d02-bb5a-8486064e5f7d None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:39.527456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02358-ee5b-4d02-bb5a-8486064e5f7d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:39.527456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd02358-ee5b-4d02-bb5a-8486064e5f7d None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:39.529069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:16:39.535081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdecdca-f917-413e-83c3-299cb56813b5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:39.535081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdecdca-f917-413e-83c3-299cb56813b5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:39.535081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdecdca-f917-413e-83c3-299cb56813b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:39.553586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3cdecdca-f917-413e-83c3-299cb56813b5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:39.554849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3cdecdca-f917-413e-83c3-299cb56813b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:39.563777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:39.607614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02358-ee5b-4d02-bb5a-8486064e5f7d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:39.622747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd02358-ee5b-4d02-bb5a-8486064e5f7d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:39.623687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdafc9e-4a13-4160-8bfc-23b25b07fdd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:39.624338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdafc9e-4a13-4160-8bfc-23b25b07fdd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:39.624619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdafc9e-4a13-4160-8bfc-23b25b07fdd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:39.624896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdafc9e-4a13-4160-8bfc-23b25b07fdd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:39.635556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdafc9e-4a13-4160-8bfc-23b25b07fdd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:39.637233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdafc9e-4a13-4160-8bfc-23b25b07fdd0 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:39.653125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 708/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:41.874811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785ac0-f628-4e1a-a214-c71c7537b1b3 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:41.875353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785ac0-f628-4e1a-a214-c71c7537b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:41.875353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4785ac0-f628-4e1a-a214-c71c7537b1b3 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:41.876633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:41.882232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad725c6-cd1c-4969-a45f-334bf186a6c8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:41.882647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad725c6-cd1c-4969-a45f-334bf186a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:41.882786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad725c6-cd1c-4969-a45f-334bf186a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:41.900644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7ad725c6-cd1c-4969-a45f-334bf186a6c8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:41.901873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7ad725c6-cd1c-4969-a45f-334bf186a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:41.910046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:41.949512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4785ac0-f628-4e1a-a214-c71c7537b1b3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:41.960201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4785ac0-f628-4e1a-a214-c71c7537b1b3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:41.964444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77fa31-525b-4082-b253-317232eb5389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:41.965071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77fa31-525b-4082-b253-317232eb5389 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:41.965362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77fa31-525b-4082-b253-317232eb5389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:41.965640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77fa31-525b-4082-b253-317232eb5389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:41.974810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77fa31-525b-4082-b253-317232eb5389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:41.976253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77fa31-525b-4082-b253-317232eb5389 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:41.986613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 737/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:44.406133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156ed8-be00-4422-8090-a32a1a68bf49 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:44.406640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156ed8-be00-4422-8090-a32a1a68bf49 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:44.406640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156ed8-be00-4422-8090-a32a1a68bf49 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:44.408056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:44.413170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155d94d-f079-4bc8-a385-8e25d47c468a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:44.413576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155d94d-f079-4bc8-a385-8e25d47c468a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:44.413733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155d94d-f079-4bc8-a385-8e25d47c468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:44.432309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c155d94d-f079-4bc8-a385-8e25d47c468a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:44.433497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c155d94d-f079-4bc8-a385-8e25d47c468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:44.441212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:44.479725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156ed8-be00-4422-8090-a32a1a68bf49 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:44.490466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156ed8-be00-4422-8090-a32a1a68bf49 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:44.494625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf333c06-c697-43fd-b04e-694daeff3790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:44.495255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333c06-c697-43fd-b04e-694daeff3790 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:44.495537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333c06-c697-43fd-b04e-694daeff3790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:44.495815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf333c06-c697-43fd-b04e-694daeff3790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:44.504599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333c06-c697-43fd-b04e-694daeff3790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:44.506081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf333c06-c697-43fd-b04e-694daeff3790 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:44.515389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 711/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:46.709069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b71d-c8f0-4769-8ab5-1ca861994b97 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:46.709674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b71d-c8f0-4769-8ab5-1ca861994b97 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:46.709674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25b71d-c8f0-4769-8ab5-1ca861994b97 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:46.711753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:46.717441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e50dd3-2b79-4f46-8d6c-d6dd5af12f4f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:46.717903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e50dd3-2b79-4f46-8d6c-d6dd5af12f4f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:46.718048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e50dd3-2b79-4f46-8d6c-d6dd5af12f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:46.736276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-91e50dd3-2b79-4f46-8d6c-d6dd5af12f4f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:46.737469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-91e50dd3-2b79-4f46-8d6c-d6dd5af12f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:46.745660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:46.785092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b71d-c8f0-4769-8ab5-1ca861994b97 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:46.796504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25b71d-c8f0-4769-8ab5-1ca861994b97 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:46.800359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208a2fe-41ff-4d31-836b-ab60f3affa80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:46.800997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208a2fe-41ff-4d31-836b-ab60f3affa80 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:46.801283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208a2fe-41ff-4d31-836b-ab60f3affa80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:46.801567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208a2fe-41ff-4d31-836b-ab60f3affa80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:46.810657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208a2fe-41ff-4d31-836b-ab60f3affa80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:46.812094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208a2fe-41ff-4d31-836b-ab60f3affa80 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:46.822693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 740/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:48.927905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95da2-9296-474f-8fbc-67c2dc37a459 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:48.928481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95da2-9296-474f-8fbc-67c2dc37a459 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:48.928481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c95da2-9296-474f-8fbc-67c2dc37a459 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:48.929990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:48.935522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ec61c-5685-45a5-bb99-3729351d8a52 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:48.936009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ec61c-5685-45a5-bb99-3729351d8a52 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:48.936117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ec61c-5685-45a5-bb99-3729351d8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:48.953926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-260ec61c-5685-45a5-bb99-3729351d8a52 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:48.955125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-260ec61c-5685-45a5-bb99-3729351d8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:48.963602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:49.001179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c95da2-9296-474f-8fbc-67c2dc37a459 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:49.012634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c95da2-9296-474f-8fbc-67c2dc37a459 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:49.016148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39adac-fd70-4d70-8e71-f961ad355f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:49.016781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39adac-fd70-4d70-8e71-f961ad355f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:49.017076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39adac-fd70-4d70-8e71-f961ad355f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:49.017338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39adac-fd70-4d70-8e71-f961ad355f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:49.026890 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39adac-fd70-4d70-8e71-f961ad355f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:49.028588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39adac-fd70-4d70-8e71-f961ad355f62 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:49.037938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 714/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:51.137220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f02-0d2c-4f21-ae5a-39a69a2d3600 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:51.137788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f02-0d2c-4f21-ae5a-39a69a2d3600 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:51.137788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f02-0d2c-4f21-ae5a-39a69a2d3600 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:51.139232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:51.144481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a460eba-71b0-4a2c-a0ce-d09cf440d895 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:51.144900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a460eba-71b0-4a2c-a0ce-d09cf440d895 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:51.145020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a460eba-71b0-4a2c-a0ce-d09cf440d895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:51.163640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3a460eba-71b0-4a2c-a0ce-d09cf440d895 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:51.165289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3a460eba-71b0-4a2c-a0ce-d09cf440d895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:51.172944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:51.212185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f02-0d2c-4f21-ae5a-39a69a2d3600 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:51.222913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f02-0d2c-4f21-ae5a-39a69a2d3600 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:51.226679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e576e8-2a2a-47ee-b987-bc780877903d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:51.227603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e576e8-2a2a-47ee-b987-bc780877903d service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:51.227885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e576e8-2a2a-47ee-b987-bc780877903d service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:51.228161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e576e8-2a2a-47ee-b987-bc780877903d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:51.237274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e576e8-2a2a-47ee-b987-bc780877903d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:51.238733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e576e8-2a2a-47ee-b987-bc780877903d service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:51.248435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 743/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:53.342696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f4397-2baa-4f27-9acb-b1a05fbab434 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:53.343235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f4397-2baa-4f27-9acb-b1a05fbab434 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:53.343356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f4397-2baa-4f27-9acb-b1a05fbab434 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:53.344695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:53.349982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439df0-c96e-41f4-a534-922f58d991c6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:53.350386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439df0-c96e-41f4-a534-922f58d991c6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:53.350535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69439df0-c96e-41f4-a534-922f58d991c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:53.357193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=70 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:53.369256 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-69439df0-c96e-41f4-a534-922f58d991c6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:53.370465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-69439df0-c96e-41f4-a534-922f58d991c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:53.378152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:53.417538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f4397-2baa-4f27-9acb-b1a05fbab434 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:53.423014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=73 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:16:53.428774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f4397-2baa-4f27-9acb-b1a05fbab434 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:53.432536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4776c8-2803-4d7f-8ec0-51b4e1302057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:53.438097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4776c8-2803-4d7f-8ec0-51b4e1302057 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:53.438097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4776c8-2803-4d7f-8ec0-51b4e1302057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:53.438097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4776c8-2803-4d7f-8ec0-51b4e1302057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:53.442651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4776c8-2803-4d7f-8ec0-51b4e1302057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:53.444098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4776c8-2803-4d7f-8ec0-51b4e1302057 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:53.454471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 717/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:55.527235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094f65d-9bc8-42b3-8ac0-06d270c14f92 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:55.528023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094f65d-9bc8-42b3-8ac0-06d270c14f92 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:55.528023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094f65d-9bc8-42b3-8ac0-06d270c14f92 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:55.529490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:55.534792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57372-928c-4ce4-b61c-f4e20bd19f0c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:55.535239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57372-928c-4ce4-b61c-f4e20bd19f0c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:55.535346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a57372-928c-4ce4-b61c-f4e20bd19f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:55.553019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-69a57372-928c-4ce4-b61c-f4e20bd19f0c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:55.554264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-69a57372-928c-4ce4-b61c-f4e20bd19f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:55.562541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:55.599711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094f65d-9bc8-42b3-8ac0-06d270c14f92 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:55.611185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094f65d-9bc8-42b3-8ac0-06d270c14f92 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:55.615075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35b149-1789-44fa-93fb-c0be6d2bd2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:55.620075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35b149-1789-44fa-93fb-c0be6d2bd2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:55.620075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35b149-1789-44fa-93fb-c0be6d2bd2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:55.620075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35b149-1789-44fa-93fb-c0be6d2bd2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:55.626403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35b149-1789-44fa-93fb-c0be6d2bd2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:55.627836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35b149-1789-44fa-93fb-c0be6d2bd2a7 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:55.637669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 746/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:57.732222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc159fca-16d9-4394-9c4f-1c2be4ba7412 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:57.732776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc159fca-16d9-4394-9c4f-1c2be4ba7412 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:57.732776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc159fca-16d9-4394-9c4f-1c2be4ba7412 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:57.734192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:57.739598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99274e-910e-48f9-ab34-ba581098ba6d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:57.740054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99274e-910e-48f9-ab34-ba581098ba6d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:57.740161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99274e-910e-48f9-ab34-ba581098ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:57.758212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-cc99274e-910e-48f9-ab34-ba581098ba6d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:57.759426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cc99274e-910e-48f9-ab34-ba581098ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:57.768237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:57.806307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc159fca-16d9-4394-9c4f-1c2be4ba7412 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:57.817130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc159fca-16d9-4394-9c4f-1c2be4ba7412 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:57.821482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314e392-648f-4489-9bb7-52f114c79b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:57.822142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e392-648f-4489-9bb7-52f114c79b52 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:57.822426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e392-648f-4489-9bb7-52f114c79b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:57.822703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314e392-648f-4489-9bb7-52f114c79b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:57.833943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314e392-648f-4489-9bb7-52f114c79b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:16:57.833943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314e392-648f-4489-9bb7-52f114c79b52 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:16:57.843739 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 720/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:16:59.901728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60a28c-e5f3-430a-8966-cc805afbca59 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:59.902362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60a28c-e5f3-430a-8966-cc805afbca59 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:59.902362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60a28c-e5f3-430a-8966-cc805afbca59 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:59.903966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:16:59.909168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8859c-bef3-4ac2-99eb-9a6177a68bd4 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:59.909604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8859c-bef3-4ac2-99eb-9a6177a68bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:59.909732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8859c-bef3-4ac2-99eb-9a6177a68bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:59.928975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b8b8859c-bef3-4ac2-99eb-9a6177a68bd4 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:16:59.931025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b8b8859c-bef3-4ac2-99eb-9a6177a68bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:16:59.938747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:16:59.975135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60a28c-e5f3-430a-8966-cc805afbca59 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:16:59.985759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60a28c-e5f3-430a-8966-cc805afbca59 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:16:59.989231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319675d8-417b-4e5f-987a-38d0a5f538aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:16:59.989927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319675d8-417b-4e5f-987a-38d0a5f538aa service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:16:59.990215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319675d8-417b-4e5f-987a-38d0a5f538aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:16:59.990493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319675d8-417b-4e5f-987a-38d0a5f538aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:16:59.999831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319675d8-417b-4e5f-987a-38d0a5f538aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:00.001269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319675d8-417b-4e5f-987a-38d0a5f538aa service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:00.011287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 749/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:09.923986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=17 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:10.006419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=17 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:20.207104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ffe5c-73f8-436c-b312-bd296a26ccf2 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:20.207713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ffe5c-73f8-436c-b312-bd296a26ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:20.207713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ffe5c-73f8-436c-b312-bd296a26ccf2 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:20.209037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 722/1471] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:20.215656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c925bd-1cc4-4d2b-ac24-d696a4227257 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:20.216165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c925bd-1cc4-4d2b-ac24-d696a4227257 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:20.216272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c925bd-1cc4-4d2b-ac24-d696a4227257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:20.234308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-30c925bd-1cc4-4d2b-ac24-d696a4227257 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:20.235493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-30c925bd-1cc4-4d2b-ac24-d696a4227257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:20.243625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 750/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:20.292482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef303bd-275f-4220-95ab-057d9153fd9f None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:20.292781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef303bd-275f-4220-95ab-057d9153fd9f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:20.293068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef303bd-275f-4220-95ab-057d9153fd9f None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:20.294461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 723/1473] 10.222.0.64 () {54 vars in 962 bytes} [Mon Jun 20 12:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:20.299192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c98f-25e7-4d7d-8f90-01d8d78910dc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:20.299484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c98f-25e7-4d7d-8f90-01d8d78910dc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:20.299763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c98f-25e7-4d7d-8f90-01d8d78910dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:20.318717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-80e5c98f-25e7-4d7d-8f90-01d8d78910dc None None] MFA Rules not processed for user `a20f362695fa4fbdb685632d4369bf04`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:20.319942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-80e5c98f-25e7-4d7d-8f90-01d8d78910dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:20.326496 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 751/1474] 10.222.0.64 () {58 vars in 1059 bytes} [Mon Jun 20 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:20.333524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef303bd-275f-4220-95ab-057d9153fd9f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:20.345026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef303bd-275f-4220-95ab-057d9153fd9f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:20.348518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3a497-e6b0-4077-8a46-27e56daff377 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:20.349148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3a497-e6b0-4077-8a46-27e56daff377 service glance] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:20.349432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3a497-e6b0-4077-8a46-27e56daff377 service glance] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:20.349709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3a497-e6b0-4077-8a46-27e56daff377 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:20.359416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3a497-e6b0-4077-8a46-27e56daff377 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:20.360857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3a497-e6b0-4077-8a46-27e56daff377 service glance] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:20.370553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 724/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:22.535254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cb359-3bb4-4364-9008-229af1e10776 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:22.535793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cb359-3bb4-4364-9008-229af1e10776 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:22.535793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cb359-3bb4-4364-9008-229af1e10776 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:22.537146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 752/1476] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:22.542997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df18c45-0596-4f43-bc73-3bb5040621ae None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:22.543430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df18c45-0596-4f43-bc73-3bb5040621ae None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:22.543556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df18c45-0596-4f43-bc73-3bb5040621ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:22.561669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7df18c45-0596-4f43-bc73-3bb5040621ae None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:22.562879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7df18c45-0596-4f43-bc73-3bb5040621ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:22.570970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 725/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:22.595298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cb359-3bb4-4364-9008-229af1e10776 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:22.608641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cb359-3bb4-4364-9008-229af1e10776 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:22.613331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:22.614087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:22.614373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:22.614647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:22.615372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:22.617594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:17:22.617594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:17:22.617594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:17:22.618759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e344d-4c84-4c43-8fa6-dccbbbe9ce69 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:22.638570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 753/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jun 20 12:17:22 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:17:24.747794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20cd80-2530-4d53-a707-d2675cbb113b None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:24.748361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20cd80-2530-4d53-a707-d2675cbb113b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:24.748361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20cd80-2530-4d53-a707-d2675cbb113b None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:24.749742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 726/1479] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:24.754974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1542-1c33-4d33-b13b-f7dc3d3cbf39 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:24.755413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1542-1c33-4d33-b13b-f7dc3d3cbf39 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:24.755617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1542-1c33-4d33-b13b-f7dc3d3cbf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:24.773676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-236b1542-1c33-4d33-b13b-f7dc3d3cbf39 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:24.774910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-236b1542-1c33-4d33-b13b-f7dc3d3cbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:24.782935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 754/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:24.829299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20cd80-2530-4d53-a707-d2675cbb113b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:24.844303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20cd80-2530-4d53-a707-d2675cbb113b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:24.849620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e933d-dc08-4d58-915e-d1e6e47a4696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:24.850292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e933d-dc08-4d58-915e-d1e6e47a4696 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:24.850575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e933d-dc08-4d58-915e-d1e6e47a4696 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:24.851422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e933d-dc08-4d58-915e-d1e6e47a4696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:24.859875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e933d-dc08-4d58-915e-d1e6e47a4696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:24.861455 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e933d-dc08-4d58-915e-d1e6e47a4696 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:24.873742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 727/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:27.115136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d88765-eec5-4679-8540-5c4fb8d456e7 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:27.115671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d88765-eec5-4679-8540-5c4fb8d456e7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:27.115788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d88765-eec5-4679-8540-5c4fb8d456e7 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:27.117665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 755/1482] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:27.122962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bdb4-8146-4956-9c6a-67def25a8505 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:27.123412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bdb4-8146-4956-9c6a-67def25a8505 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:27.123523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472bdb4-8146-4956-9c6a-67def25a8505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:27.141970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4472bdb4-8146-4956-9c6a-67def25a8505 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:27.143184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4472bdb4-8146-4956-9c6a-67def25a8505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:27.151150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 728/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:27.188393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d88765-eec5-4679-8540-5c4fb8d456e7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:27.199874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d88765-eec5-4679-8540-5c4fb8d456e7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:27.203465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5be2c7-5295-46d2-b310-097bad91ed4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:27.204100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be2c7-5295-46d2-b310-097bad91ed4c service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:27.204387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be2c7-5295-46d2-b310-097bad91ed4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:27.204669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5be2c7-5295-46d2-b310-097bad91ed4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:27.213686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5be2c7-5295-46d2-b310-097bad91ed4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:27.215221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5be2c7-5295-46d2-b310-097bad91ed4c service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:27.224577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 756/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:29.325429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0f9d-f9b6-42a9-a085-6bc5c451eafe None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:29.325930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0f9d-f9b6-42a9-a085-6bc5c451eafe None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:29.326028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0f9d-f9b6-42a9-a085-6bc5c451eafe None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:29.327442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 729/1485] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:29.332758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c1ba-be8e-45dd-b7b9-e2fa535e4fb6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:29.336389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c1ba-be8e-45dd-b7b9-e2fa535e4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:29.336389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c1ba-be8e-45dd-b7b9-e2fa535e4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:29.352451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-79e7c1ba-be8e-45dd-b7b9-e2fa535e4fb6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:29.353651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-79e7c1ba-be8e-45dd-b7b9-e2fa535e4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:29.361421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 757/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:17:29.399963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0f9d-f9b6-42a9-a085-6bc5c451eafe None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:29.410840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b0f9d-f9b6-42a9-a085-6bc5c451eafe None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:29.415194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c82bfd-33bf-47d7-ab64-a1d8732cd037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:29.415825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c82bfd-33bf-47d7-ab64-a1d8732cd037 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:29.416106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c82bfd-33bf-47d7-ab64-a1d8732cd037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:29.416381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c82bfd-33bf-47d7-ab64-a1d8732cd037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:29.425509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c82bfd-33bf-47d7-ab64-a1d8732cd037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:29.426986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c82bfd-33bf-47d7-ab64-a1d8732cd037 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:29.436295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 730/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:31.584314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ff13-f894-4113-bb17-031a3dff5c2d None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:31.585405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ff13-f894-4113-bb17-031a3dff5c2d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:31.585405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0ff13-f894-4113-bb17-031a3dff5c2d None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:31.586868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 758/1488] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:31.592055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392141f-fce8-4244-aaeb-f24f6030f0a3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:31.592508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392141f-fce8-4244-aaeb-f24f6030f0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:31.592608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392141f-fce8-4244-aaeb-f24f6030f0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:31.610636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3392141f-fce8-4244-aaeb-f24f6030f0a3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:31.611835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3392141f-fce8-4244-aaeb-f24f6030f0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:31.620137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 731/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:31.660732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0ff13-f894-4113-bb17-031a3dff5c2d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:31.672094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0ff13-f894-4113-bb17-031a3dff5c2d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:31.675635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd8477-eb06-4103-b572-5fc0c9364a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:31.676267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd8477-eb06-4103-b572-5fc0c9364a9c service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:31.676554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd8477-eb06-4103-b572-5fc0c9364a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:31.676830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd8477-eb06-4103-b572-5fc0c9364a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:31.685771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd8477-eb06-4103-b572-5fc0c9364a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:31.687300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd8477-eb06-4103-b572-5fc0c9364a9c service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:31.696733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 759/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:34.165763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486032-a3e9-4b6c-884f-b12fcd8d2ce7 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:34.166343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486032-a3e9-4b6c-884f-b12fcd8d2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:34.166453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c486032-a3e9-4b6c-884f-b12fcd8d2ce7 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:34.167807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 732/1491] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jun 20 12:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:17:34.172990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01758d-e07a-4c24-8b9d-ef7af7a2c687 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:34.173417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01758d-e07a-4c24-8b9d-ef7af7a2c687 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:34.173556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01758d-e07a-4c24-8b9d-ef7af7a2c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:34.192540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-af01758d-e07a-4c24-8b9d-ef7af7a2c687 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:17:34.193732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-af01758d-e07a-4c24-8b9d-ef7af7a2c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:17:34.202220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 760/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jun 20 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:17:34.240832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c486032-a3e9-4b6c-884f-b12fcd8d2ce7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:17:34.252004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c486032-a3e9-4b6c-884f-b12fcd8d2ce7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:17:34.255427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab6f3a-d153-4d67-a1f8-501704281e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:17:34.256053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab6f3a-d153-4d67-a1f8-501704281e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:17:34.256333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab6f3a-d153-4d67-a1f8-501704281e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:17:34.256607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab6f3a-d153-4d67-a1f8-501704281e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:17:34.265359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab6f3a-d153-4d67-a1f8-501704281e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:17:34.266819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab6f3a-d153-4d67-a1f8-501704281e33 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:17:34.276489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 733/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:17:44.186489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=33 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:17:44.271850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=33 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:09.114501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.114999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.115106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.133027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:09.134261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:09.142016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 761/1494] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:09.151672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.152163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.152530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.170974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:09.172171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:09.180188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 734/1495] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:09.184681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:09.194391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478de1a-a31e-4ab2-ab66-b24967868283 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:09.198848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:09.199494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.199777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.200057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.200779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:19:09.201118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:09.202182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:09.202182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:19:09.202182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:19:09.203053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:09.215050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 762/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:19:09.223156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:09.233047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573f500-4bb7-46f9-aaf9-656fdcda3ca9 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:09.237619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:09.238298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.238590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.238871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.239597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:09.241423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:09.241423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:19:09.241423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:19:09.242660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:09.412579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 735/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:19:09 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:19:09.416901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:09.426825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5bed0-ede8-4a0e-9420-ce73db466c9b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:09.483438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:09.484109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.484399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.484681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.485368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:09.486427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:09.486427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:19:09.486427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:19:09.487621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:09.588596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 763/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:19:09 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:19:09.592660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:09.604036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55d6a1-5e2b-493b-9626-e1aeab374e6f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:09.608620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:09.609332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.609595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.609908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.614971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:09.614971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:09.614971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:19:09.614971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:19:09.614971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:09.626159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 736/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:19:09.630369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:09.640969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf28f3-92c6-450f-8073-9330210ffb9d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:09.645558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:09.646243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.646524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.646800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.648171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:09.649184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:09.649184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:19:09.649184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:19:09.650157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe128e-6469-494f-990d-9b659ba8bfaf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:09.664655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 764/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:19:09.668810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:09.679539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cf41f-4531-4657-9742-7bb70f9f012f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:09.684087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:09.684964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.685252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.685700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] PATH_INFO: `/v3/projects/e65f98fe639a447dbb85f2f9f4c2b474/users/ae32295f5ef843bbb66891597dd5b242/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.700580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65f98fe639a447dbb85f2f9f4c2b474, user_id=ae32295f5ef843bbb66891597dd5b242, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:09.701622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:09.701622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:19:09.701622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:19:09.703560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e98333-9d20-4db7-8abb-54ecce6a71b0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:09.807056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 737/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:19:09 2022] PUT /identity/v3/projects/e65f98fe639a447dbb85f2f9f4c2b474/users/ae32295f5ef843bbb66891597dd5b242/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:19:09.818336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fab1d-a6d5-4bd1-b4c1-5dc6ec50b20e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.818630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fab1d-a6d5-4bd1-b4c1-5dc6ec50b20e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.818916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102fab1d-a6d5-4bd1-b4c1-5dc6ec50b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.846073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-102fab1d-a6d5-4bd1-b4c1-5dc6ec50b20e None None] MFA Rules not processed for user `ae32295f5ef843bbb66891597dd5b242`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:09.847285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-102fab1d-a6d5-4bd1-b4c1-5dc6ec50b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:09.911203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 765/1502] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:09.925166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f82a7-8df8-46c0-bf1e-cd963073d8cc None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.925461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f82a7-8df8-46c0-bf1e-cd963073d8cc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.925743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f82a7-8df8-46c0-bf1e-cd963073d8cc None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.927134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 738/1503] 10.222.0.64 () {54 vars in 963 bytes} [Mon Jun 20 12:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:09.932286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac1a1-7c1a-42d5-9415-0dee53d77d27 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:09.932583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac1a1-7c1a-42d5-9415-0dee53d77d27 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:09.932906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac1a1-7c1a-42d5-9415-0dee53d77d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:09.952649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9d0ac1a1-7c1a-42d5-9415-0dee53d77d27 None None] MFA Rules not processed for user `4761c5c956f84b15a76074531901c462`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:09.954182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9d0ac1a1-7c1a-42d5-9415-0dee53d77d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:10.001574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:10.008908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 766/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Mon Jun 20 12:19:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:10.016421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f82a7-8df8-46c0-bf1e-cd963073d8cc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:10.027822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f82a7-8df8-46c0-bf1e-cd963073d8cc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:10.031389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:10.032028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:10.032317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:10.032597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:10.041633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:10.043112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:10.051876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 739/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:10.097302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751312f-6e8b-4c84-b408-0a1115b9e033 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:10.097595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751312f-6e8b-4c84-b408-0a1115b9e033 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:10.097903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751312f-6e8b-4c84-b408-0a1115b9e033 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:10.099206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 767/1506] 10.222.0.64 () {52 vars in 829 bytes} [Mon Jun 20 12:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:19:10.103433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:10.165682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ffe5-fa8c-45ef-bbc1-821ee489683e service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:10.170243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:10.171112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:10.171398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:10.171677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] PATH_INFO: `/v3/users/ae32295f5ef843bbb66891597dd5b242` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:10.172917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae32295f5ef843bbb66891597dd5b242)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:10.173999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:10.173999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:19:10.173999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:19:10.175198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:10.400975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae32295f5ef843bbb66891597dd5b242'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:10.420471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae32295f5ef843bbb66891597dd5b242'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:10.433212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae32295f5ef843bbb66891597dd5b242'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:10.434044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae32295f5ef843bbb66891597dd5b242'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:10.434779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae32295f5ef843bbb66891597dd5b242'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:10.438841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:10.532527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 740/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:19:10 2022] DELETE /identity/v3/users/ae32295f5ef843bbb66891597dd5b242 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:19:10.537035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:10.537515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:10.537744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:10.556069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:19:10.557281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:10.618122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 768/1508] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:19:10.627577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:10.628986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:10.686667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a694a-3016-4acf-bbb7-597e30317c34 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:10.690219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be975e-2a96-4c68-adbe-8d590c68e2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:10.690870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be975e-2a96-4c68-adbe-8d590c68e2ae service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:10.691159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be975e-2a96-4c68-adbe-8d590c68e2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:10.691441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be975e-2a96-4c68-adbe-8d590c68e2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:10.701002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be975e-2a96-4c68-adbe-8d590c68e2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:10.702503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be975e-2a96-4c68-adbe-8d590c68e2ae service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:10.712079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 741/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:19:11.191379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:19:11.192836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:19:11.204818 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e606-49c2-45c0-b8f2-472a8adee42b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:19:11.211852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:19:11.211852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:19:11.211852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:19:11.211852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] PATH_INFO: `/v3/projects/e65f98fe639a447dbb85f2f9f4c2b474` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:19:11.212464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65f98fe639a447dbb85f2f9f4c2b474)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:19:11.213498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:19:11.213498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:19:11.213498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:19:11.214734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:19:11.346546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65f98fe639a447dbb85f2f9f4c2b474', 'request_id': 'req-c12b2482-0307-4a20-85e0-52b8faac0568'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:11.424150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65f98fe639a447dbb85f2f9f4c2b474', 'request_id': 'req-c12b2482-0307-4a20-85e0-52b8faac0568'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:11.430767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65f98fe639a447dbb85f2f9f4c2b474', 'request_id': 'req-c12b2482-0307-4a20-85e0-52b8faac0568'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:11.450253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] The token cache is being invalidate because project e65f98fe639a447dbb85f2f9f4c2b474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:19:11.450548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:11.451208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c12b2482-0307-4a20-85e0-52b8faac0568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:19:11.452876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 769/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:19:11 2022] DELETE /identity/v3/projects/e65f98fe639a447dbb85f2f9f4c2b474 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:19:20.707721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:19:21.447185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:20:51.587870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254f2f-3b81-4df4-a7d9-c9db6f579651 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:51.588371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254f2f-3b81-4df4-a7d9-c9db6f579651 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:51.588486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05254f2f-3b81-4df4-a7d9-c9db6f579651 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:51.589887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:51.594713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0bc6c-0de1-4a41-8ca6-87fc4e01985e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:51.595172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0bc6c-0de1-4a41-8ca6-87fc4e01985e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:51.595281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0bc6c-0de1-4a41-8ca6-87fc4e01985e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:51.613048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a7c0bc6c-0de1-4a41-8ca6-87fc4e01985e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:51.614275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a7c0bc6c-0de1-4a41-8ca6-87fc4e01985e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:51.673088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:51.828653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05254f2f-3b81-4df4-a7d9-c9db6f579651 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:51.830628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-05254f2f-3b81-4df4-a7d9-c9db6f579651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:51.905334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05254f2f-3b81-4df4-a7d9-c9db6f579651 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:51.910833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4275c-9757-45a1-ab55-5f8ac10d8cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:51.911485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4275c-9757-45a1-ab55-5f8ac10d8cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:51.911771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4275c-9757-45a1-ab55-5f8ac10d8cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:51.912044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4275c-9757-45a1-ab55-5f8ac10d8cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:51.920286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4275c-9757-45a1-ab55-5f8ac10d8cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:51.921939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4275c-9757-45a1-ab55-5f8ac10d8cf9 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:51.931873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 743/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:52.771677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba21f-b199-4d85-bd60-3cd3424d5fbe None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:52.772293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba21f-b199-4d85-bd60-3cd3424d5fbe None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:52.772293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba21f-b199-4d85-bd60-3cd3424d5fbe None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:52.773642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:52.778715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1607e-1b49-4e90-9020-c21658c7a12e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:52.779118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1607e-1b49-4e90-9020-c21658c7a12e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:52.779273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1607e-1b49-4e90-9020-c21658c7a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:52.797496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-64b1607e-1b49-4e90-9020-c21658c7a12e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:52.798724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-64b1607e-1b49-4e90-9020-c21658c7a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:52.806898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:52.966553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba21f-b199-4d85-bd60-3cd3424d5fbe None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:52.983217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba21f-b199-4d85-bd60-3cd3424d5fbe None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:52.990281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6668-8516-4440-8627-a5c4b79e4e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:52.991080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6668-8516-4440-8627-a5c4b79e4e57 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:52.991481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6668-8516-4440-8627-a5c4b79e4e57 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:52.991810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6668-8516-4440-8627-a5c4b79e4e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:53.001172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6668-8516-4440-8627-a5c4b79e4e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:53.003368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6668-8516-4440-8627-a5c4b79e4e57 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:53.014683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 772/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:20:53.115483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc982-7036-418e-8937-6e95ada55b6e None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:53.115920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc982-7036-418e-8937-6e95ada55b6e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:53.116146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bc982-7036-418e-8937-6e95ada55b6e None None] PATH_INFO: `/v3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:53.117514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 745/1517] 10.222.0.72 () {54 vars in 925 bytes} [Mon Jun 20 12:20:53 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:20:53.124064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d903-e591-47df-8da8-9756c2e1b379 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:53.124354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d903-e591-47df-8da8-9756c2e1b379 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:53.124662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10d903-e591-47df-8da8-9756c2e1b379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:53.142697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ba10d903-e591-47df-8da8-9756c2e1b379 None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:53.143960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ba10d903-e591-47df-8da8-9756c2e1b379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:53.207535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 773/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Jun 20 12:20:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:57.116991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7636-3e7e-40de-85ce-453ec354c1a8 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:57.117519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7636-3e7e-40de-85ce-453ec354c1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:57.117519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a7636-3e7e-40de-85ce-453ec354c1a8 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:57.119157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 746/1519] 10.222.0.64 () {54 vars in 960 bytes} [Mon Jun 20 12:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:20:57.124466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1e6eb-0688-4f08-9c68-8affdee219b8 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:57.124891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1e6eb-0688-4f08-9c68-8affdee219b8 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:57.125025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1e6eb-0688-4f08-9c68-8affdee219b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:57.143879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d5b1e6eb-0688-4f08-9c68-8affdee219b8 None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:20:57.145086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d5b1e6eb-0688-4f08-9c68-8affdee219b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:20:57.154579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 774/1520] 10.222.0.64 () {58 vars in 1057 bytes} [Mon Jun 20 12:20:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:20:57.161912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7636-3e7e-40de-85ce-453ec354c1a8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:20:57.175698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a7636-3e7e-40de-85ce-453ec354c1a8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:20:57.181444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fb2b2-de3b-4ea9-bb26-068091262bbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:20:57.182116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb2b2-de3b-4ea9-bb26-068091262bbe service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:20:57.182399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb2b2-de3b-4ea9-bb26-068091262bbe service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:20:57.182674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fb2b2-de3b-4ea9-bb26-068091262bbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:20:57.190764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fb2b2-de3b-4ea9-bb26-068091262bbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:20:57.192369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fb2b2-de3b-4ea9-bb26-068091262bbe service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:20:57.203038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 747/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:20:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:04.260660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3e0da-abbf-4d13-8d2f-10f60b436015 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:04.261233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3e0da-abbf-4d13-8d2f-10f60b436015 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:04.261233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3e0da-abbf-4d13-8d2f-10f60b436015 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:04.262648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:04.267699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54296-78a9-4278-a035-73f63a62fd80 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:04.268174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54296-78a9-4278-a035-73f63a62fd80 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:04.268290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df54296-78a9-4278-a035-73f63a62fd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:04.286634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2df54296-78a9-4278-a035-73f63a62fd80 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:04.287816 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2df54296-78a9-4278-a035-73f63a62fd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:04.295745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:04.448862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3e0da-abbf-4d13-8d2f-10f60b436015 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:04.464322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3e0da-abbf-4d13-8d2f-10f60b436015 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:04.469823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e8b5a-4824-4638-9452-e76b3ebe94fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:04.470487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8b5a-4824-4638-9452-e76b3ebe94fe service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:04.470769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8b5a-4824-4638-9452-e76b3ebe94fe service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:04.471049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e8b5a-4824-4638-9452-e76b3ebe94fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:04.481013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8b5a-4824-4638-9452-e76b3ebe94fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:04.482793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e8b5a-4824-4638-9452-e76b3ebe94fe service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:04.493303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 776/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:05.317420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20e80-7a50-451d-9676-40da5f01b331 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:05.318005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20e80-7a50-451d-9676-40da5f01b331 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:05.318005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20e80-7a50-451d-9676-40da5f01b331 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:05.319395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 12:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:05.324392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a085-262a-4f4d-a6e9-ad893af1e99a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:05.324828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a085-262a-4f4d-a6e9-ad893af1e99a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:05.324936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a085-262a-4f4d-a6e9-ad893af1e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:05.343260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5c51a085-262a-4f4d-a6e9-ad893af1e99a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:05.344442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5c51a085-262a-4f4d-a6e9-ad893af1e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:05.352898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 12:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:05.504275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20e80-7a50-451d-9676-40da5f01b331 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:05.518885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20e80-7a50-451d-9676-40da5f01b331 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:05.524689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8967-75af-4337-a95d-1a76d5463649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:05.525327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8967-75af-4337-a95d-1a76d5463649 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:05.525607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8967-75af-4337-a95d-1a76d5463649 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:05.525910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8967-75af-4337-a95d-1a76d5463649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:05.534191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d8967-75af-4337-a95d-1a76d5463649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:05.535805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d8967-75af-4337-a95d-1a76d5463649 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:05.545821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 750/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:09.589166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f684-8f5e-4189-8ea6-e6e2ec299d85 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:09.589735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f684-8f5e-4189-8ea6-e6e2ec299d85 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:09.589735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f684-8f5e-4189-8ea6-e6e2ec299d85 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:09.591142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:09.596651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2b89-d357-431b-b318-f7422241cfd0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:09.597117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2b89-d357-431b-b318-f7422241cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:09.597229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2b89-d357-431b-b318-f7422241cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:09.618442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b3bf2b89-d357-431b-b318-f7422241cfd0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:09.619354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b3bf2b89-d357-431b-b318-f7422241cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:09.627420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:09.664062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1f684-8f5e-4189-8ea6-e6e2ec299d85 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:09.665832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cff1f684-8f5e-4189-8ea6-e6e2ec299d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:09.722596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1f684-8f5e-4189-8ea6-e6e2ec299d85 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:09.726082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aa48e-7b45-4bcb-b240-78f4ee718161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:09.726819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa48e-7b45-4bcb-b240-78f4ee718161 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:09.727157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa48e-7b45-4bcb-b240-78f4ee718161 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:09.727580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aa48e-7b45-4bcb-b240-78f4ee718161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:09.736582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aa48e-7b45-4bcb-b240-78f4ee718161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:09.738053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aa48e-7b45-4bcb-b240-78f4ee718161 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:09.743467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:09.748152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 779/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:11.803211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a47fb-3eef-4af9-abd1-646132eb95f8 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:11.803760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a47fb-3eef-4af9-abd1-646132eb95f8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:11.803760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a47fb-3eef-4af9-abd1-646132eb95f8 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:11.806080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:11.811203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5dec4-3c62-4049-a11f-e55a33f95602 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:11.811669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5dec4-3c62-4049-a11f-e55a33f95602 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:11.811767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5dec4-3c62-4049-a11f-e55a33f95602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:11.829399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-31c5dec4-3c62-4049-a11f-e55a33f95602 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:11.830635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-31c5dec4-3c62-4049-a11f-e55a33f95602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:11.838468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:11.875257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a47fb-3eef-4af9-abd1-646132eb95f8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:11.886396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a47fb-3eef-4af9-abd1-646132eb95f8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:11.889988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c916700-0433-43df-9f48-18b33996e7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:11.890630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c916700-0433-43df-9f48-18b33996e7be service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:11.890916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c916700-0433-43df-9f48-18b33996e7be service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:11.891197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c916700-0433-43df-9f48-18b33996e7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:11.901005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c916700-0433-43df-9f48-18b33996e7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:11.902768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c916700-0433-43df-9f48-18b33996e7be service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:11.912341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 753/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:15.467705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45527f0-fae7-4ceb-98ab-67f2320acfbe None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:15.468187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45527f0-fae7-4ceb-98ab-67f2320acfbe None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:15.468302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45527f0-fae7-4ceb-98ab-67f2320acfbe None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:15.469646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:15.474746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9e92-9511-457c-8e19-a9bd46eb5751 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:15.475181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9e92-9511-457c-8e19-a9bd46eb5751 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:15.475311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d9e92-9511-457c-8e19-a9bd46eb5751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:15.494706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-538d9e92-9511-457c-8e19-a9bd46eb5751 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:15.495956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-538d9e92-9511-457c-8e19-a9bd46eb5751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:15.503637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:15.808158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45527f0-fae7-4ceb-98ab-67f2320acfbe None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:15.809885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c45527f0-fae7-4ceb-98ab-67f2320acfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:15.867021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45527f0-fae7-4ceb-98ab-67f2320acfbe None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:15.870728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219ee3c-2959-4c20-a3bd-8e62ec9851fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:15.871369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219ee3c-2959-4c20-a3bd-8e62ec9851fe service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:15.871655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219ee3c-2959-4c20-a3bd-8e62ec9851fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:15.871937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219ee3c-2959-4c20-a3bd-8e62ec9851fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:15.880999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219ee3c-2959-4c20-a3bd-8e62ec9851fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:15.882478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219ee3c-2959-4c20-a3bd-8e62ec9851fe service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:15.892568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 782/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:17.953885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42408c-f495-4599-8c45-62dbddab394d None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:17.954462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42408c-f495-4599-8c45-62dbddab394d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:17.954462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42408c-f495-4599-8c45-62dbddab394d None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:17.955809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 12:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:21:17.961077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62452-a83d-4f5b-a13a-67d97d018c7f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:17.961504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62452-a83d-4f5b-a13a-67d97d018c7f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:17.961650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62452-a83d-4f5b-a13a-67d97d018c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:17.979607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-32e62452-a83d-4f5b-a13a-67d97d018c7f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:21:17.980814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-32e62452-a83d-4f5b-a13a-67d97d018c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:17.988694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 12:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:21:18.299515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42408c-f495-4599-8c45-62dbddab394d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:21:18.301170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9b42408c-f495-4599-8c45-62dbddab394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:21:18.314918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42408c-f495-4599-8c45-62dbddab394d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:21:18.318345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c241a-02f6-4fc7-a9f5-5a38a32589c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:21:18.318972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c241a-02f6-4fc7-a9f5-5a38a32589c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:21:18.319250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c241a-02f6-4fc7-a9f5-5a38a32589c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:21:18.319520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c241a-02f6-4fc7-a9f5-5a38a32589c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:21:18.328666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c241a-02f6-4fc7-a9f5-5a38a32589c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:21:18.330123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c241a-02f6-4fc7-a9f5-5a38a32589c7 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:21:18.339822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 756/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:21:27.974420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=32 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:21:28.335231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=70 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:46.253001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184977a1-d1cf-4946-aee7-9636c0d26285 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.253662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184977a1-d1cf-4946-aee7-9636c0d26285 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.253662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184977a1-d1cf-4946-aee7-9636c0d26285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.282844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-184977a1-d1cf-4946-aee7-9636c0d26285 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.284545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-184977a1-d1cf-4946-aee7-9636c0d26285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.300699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 784/1540] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:22:46.312656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c14d7-7a6b-44dc-a50d-7ad5dc0c202b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.314589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c14d7-7a6b-44dc-a50d-7ad5dc0c202b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.314589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c14d7-7a6b-44dc-a50d-7ad5dc0c202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.339014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f1554-109d-43e3-9a3c-b25a7ca22918 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.339014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f1554-109d-43e3-9a3c-b25a7ca22918 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.339014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f1554-109d-43e3-9a3c-b25a7ca22918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.344861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b63c14d7-7a6b-44dc-a50d-7ad5dc0c202b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.346130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b63c14d7-7a6b-44dc-a50d-7ad5dc0c202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.360173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 757/1541] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.361844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.362346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.362827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.374907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e99f1554-109d-43e3-9a3c-b25a7ca22918 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.385122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e99f1554-109d-43e3-9a3c-b25a7ca22918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.389254 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.390710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.392465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 785/1542] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:22:46.397830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac90b-72f2-44e4-be09-07d645a1f8dc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.397830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac90b-72f2-44e4-be09-07d645a1f8dc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.397830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac90b-72f2-44e4-be09-07d645a1f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.410349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 758/1543] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.411298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.416098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9a3ac90b-72f2-44e4-be09-07d645a1f8dc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.417342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9a3ac90b-72f2-44e4-be09-07d645a1f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.425095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518aff77-5f75-48ab-bf65-28f8f917b264 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.437446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.438168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.438451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.438722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 786/1544] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.438847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.439474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:46.439781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.440083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c178e7-035a-4ab9-9352-f05346c640f2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.440729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c178e7-035a-4ab9-9352-f05346c640f2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.441018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c178e7-035a-4ab9-9352-f05346c640f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.441126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:46.441126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:22:46.441126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:22:46.441991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7466ad-bb94-4ec5-a9fb-f2e5b4eed01b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.461852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 759/1545] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:46.461852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450bdd0-2d1e-4365-9f54-2f128bcd8c4f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.461852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450bdd0-2d1e-4365-9f54-2f128bcd8c4f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.461852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450bdd0-2d1e-4365-9f54-2f128bcd8c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.462326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-26c178e7-035a-4ab9-9352-f05346c640f2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.462649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-26c178e7-035a-4ab9-9352-f05346c640f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.471241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 787/1546] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.478139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87569a-886b-40ed-ad1f-874c3da63c56 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.480989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87569a-886b-40ed-ad1f-874c3da63c56 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.480989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87569a-886b-40ed-ad1f-874c3da63c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.484919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3450bdd0-2d1e-4365-9f54-2f128bcd8c4f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.486215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3450bdd0-2d1e-4365-9f54-2f128bcd8c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.495611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 760/1547] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.499029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8f87569a-886b-40ed-ad1f-874c3da63c56 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.500496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29a31b-3553-491b-9b33-0bcfd31ad93e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.500632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8f87569a-886b-40ed-ad1f-874c3da63c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.500728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29a31b-3553-491b-9b33-0bcfd31ad93e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.500991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29a31b-3553-491b-9b33-0bcfd31ad93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.510678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 788/1548] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.511982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.512281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.512564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.520001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7f29a31b-3553-491b-9b33-0bcfd31ad93e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.521214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7f29a31b-3553-491b-9b33-0bcfd31ad93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.529962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 761/1549] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.534827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f1827-7568-4a16-afe3-5327228db876 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.534827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f1827-7568-4a16-afe3-5327228db876 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.534827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f1827-7568-4a16-afe3-5327228db876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.535134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.535134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.544239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 789/1550] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.545192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.555780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-629f1827-7568-4a16-afe3-5327228db876 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.561217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-629f1827-7568-4a16-afe3-5327228db876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.563068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385dc1f-360f-4e8f-b0b1-a5d03ffcc4af None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.571789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.571997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 762/1551] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.572102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.572102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.572102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.572382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.572382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.572568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.572654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.572760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:46.572760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:22:46.572760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:22:46.573890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.589857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.590965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.598743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 763/1552] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.599621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.609015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f5676-a0df-4271-b6df-731e6c89f30b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.613426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.614090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.614375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.614651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.616326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:46.616661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.618301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80f2b1-fc32-411a-9ea7-1a3a5f6063b8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.629496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 764/1553] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:46.631325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745559-3268-49b2-9e7b-c508beefc067 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.631813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745559-3268-49b2-9e7b-c508beefc067 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.632264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2745559-3268-49b2-9e7b-c508beefc067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.636700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 790/1554] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:46.637624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.654686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f2745559-3268-49b2-9e7b-c508beefc067 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.656004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f2745559-3268-49b2-9e7b-c508beefc067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.701929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213aa44-ceb4-448a-bf2b-b38a669844ac admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.706735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.707400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.707690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.707972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.708701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:46.709086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.710756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe16e4-5e2b-48d0-94ec-1625d9332d31 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.716446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 765/1555] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.717822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.718139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.718423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.726011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 791/1556] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:46.727604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.728199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.728691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.736703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.737945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.746535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 766/1557] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.747380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.747509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:46.748705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:46.756984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 792/1558] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:46.757774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.759412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc6db-4e12-4114-b0be-cbdccae4d096 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.764077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.764853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.765019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.765301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.766096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:46.766406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.767529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202bd0-aedc-4aa9-adda-fbc68447d423 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.768042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.772525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.773188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.773479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.773759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.774522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:46.774835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.776466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.781172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 767/1559] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:46.781956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.789670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 793/1560] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:46.790538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.792610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b990-6da2-4470-ad01-9241a9adee67 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.801359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.802050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.802337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.803317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.804059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.806075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.811993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef48897-ac57-45e6-a12d-71fb565dd5fc admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.816646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.817307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.817599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.817992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.818739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.820907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.909828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 768/1561] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:46.910722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.932377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 794/1562] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:46.935659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:46.943015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933513c-f8c2-41f9-b69e-3d223d5ac1ba admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.966413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:46.978050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca01cf-471b-4997-b4dc-636936c17862 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:46.982710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:46.983393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:46.983681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:46.983959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:46.984687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:46.984996 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:46.986675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:46.994859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:46.999116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 769/1563] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:47.000142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.001424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.002131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.002417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.002694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.003383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.005288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.009827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e5d3f-a000-4d0f-94de-d29387c6848f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.014559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.015422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.015920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.016349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.017273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:47.017658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.019814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa678-235c-4923-9e82-b0a5ba7f4c5b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.032167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 770/1564] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:47.033411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.033700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.034025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.051707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:47.053569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:47.061716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 771/1565] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:47.065196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.072532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c865e-b053-4bcf-a2b5-e0a479e0f1c5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.077484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.078208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.079208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.079208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.079506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.081356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.132642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 795/1566] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:46 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.133540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.156085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 772/1567] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.162727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.198459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075b981-b666-460d-aac8-cf9ec2e9b30b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.231548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c23e7-6bf8-4606-b220-73fedcf9a9ff admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.236221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.236888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.237173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.237449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.238306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.239378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:47.239378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:22:47.239378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:22:47.240723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.255989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.257002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.257002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.257216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.257967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.262540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.330617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 773/1568] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.331626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.342050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2519b3-f551-482d-875c-f782e0e4f334 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.346741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.347385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.347670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.347948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.348668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.350993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.360759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 774/1569] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:47.361661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.371125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75195220-3a02-4239-b192-9a9eaf1d2817 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.375645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.376251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.376532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.376806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.377480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.379381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.392774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 796/1570] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.392774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.454286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3b058-a873-47ce-9889-f4bceb14fc84 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.459507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.460250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.460535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.460820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.461540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.463570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.479899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 775/1571] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/projects => generated 403 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.480816 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.543968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c757e-6fb3-48d5-8960-1eeb5382ca10 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.549065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.549729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.550082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.555499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.555499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:22:47.555499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.555499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.556662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:47.565336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 776/1572] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:22:47.566162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.576279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93ad18-a884-4e7a-9d6c-c93eee9fa21f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.577084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:47.580858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.581507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.581861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.582147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.584548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.588115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 797/1573] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.588258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.588382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.646143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb437-b6dc-4f20-8430-0246498f0231 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.652005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.652682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.658373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.658373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.658373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.658373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.680091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 777/1574] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.687238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.690418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c42309-ac99-43f0-a17d-e737b731d227 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.696129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.696764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.697048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.697324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.698069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.699767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.711519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 778/1575] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:47.712279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.721650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ce606-06ec-45e5-9be3-d273cdc97087 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.726595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.727211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.727493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.727765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.728463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.730173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.744673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 779/1576] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:47.745449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.754749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bd26-f234-4c48-bcad-e4af9cd5bd77 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.761746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.761746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.761746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.761746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.762206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.764183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.783186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 798/1577] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.783840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.795629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7dce09-6ae9-4fde-98a2-0ad7a3515a6b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.801710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.802393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.802756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.803014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.803864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.805819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.856874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 780/1578] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.857692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.867813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbde3-34a3-40de-94f6-c9db6860caa7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.872416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.873067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.873338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.873619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.874347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.876259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:47.925712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 799/1579] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:47.926722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:47.936851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4291a-31e4-4352-9ed1-5ac8edbeacf0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:47.941552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:47.942221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:47.942511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:47.942794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:47.944172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:47.946101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.053172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 781/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:48.054241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.116435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5989723-8cea-4266-a79f-9a9e2c238b76 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.121082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.121752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.125675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.125675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.125675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.125675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.127033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 800/1581] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:47 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:48.128087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.138490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69902276-e0a5-40f7-b7a0-df15bda05107 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.141873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 782/1582] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.141873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.145837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.146533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.147115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.147219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.147863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.149067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60e8e-0ac6-47a7-af86-d75b91e9cebb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.149464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.154209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.155086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.155369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.155648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] PATH_INFO: `/v3/projects/644e467d3892497a92a4c23fa12f6c03/users/6988a4385f3746cab807e36d5c515013/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.163722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 801/1583] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.163722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.172837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=644e467d3892497a92a4c23fa12f6c03, user_id=6988a4385f3746cab807e36d5c515013, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.174152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c33298-c097-401d-b520-a1bf63ad40d0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.175608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.179475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.180524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.180814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.181115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.181848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.183470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.194169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 802/1584] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.201410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.204333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12c63-92ae-4658-b463-7e9709c87295 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.208990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.209932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.210222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.210503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.211206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.212756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.222711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 803/1585] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.223640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.233677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a72ef2-d854-442d-8af4-2d2be91523f2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.238183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.238795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.239081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.239358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.240689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.242264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.252272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 804/1586] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.253148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.262868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b4ec4-c149-4c51-b3be-8951b1302f18 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.268360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 783/1587] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/644e467d3892497a92a4c23fa12f6c03/users/6988a4385f3746cab807e36d5c515013/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:48.279094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.320576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.321165 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.321456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.321740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.322473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.324409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.329512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.342814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612371f8-c612-4b5c-ace0-ae4d06135aca admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.347580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.348264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.348541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.348821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.350116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.351735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.361562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 784/1588] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.363922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.372616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab3d7a-0691-466e-a975-5d9b8f84ad4d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.377540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.378233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.378524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.378806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.379510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.381162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.390763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 785/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.391533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.400965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77a1e-afe7-45a8-a646-7c80ddb4d8aa admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.405940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.406788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.407075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.407355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] PATH_INFO: `/v3/projects/3c7566543a6145b7b1a01612aff1c02a/users/41eb98b3a8434e7e9734eb747047a87d/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.417023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.422755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7566543a6145b7b1a01612aff1c02a, user_id=41eb98b3a8434e7e9734eb747047a87d, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.425899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 805/1590] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:48 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:48.425899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.426196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.436105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c929d97-a63c-4be9-bb75-4631cfa2384e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.440728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.441379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.441662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.441969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.442689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.444453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.454397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 806/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.455363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.465094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5b37-b9c3-4495-99aa-26ffad3e7054 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.469691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.470336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.470620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.470897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.471588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.473180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.484618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 807/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.485404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.495375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b71cb-aebd-4718-b3dd-a137fd86225b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.499926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ef1bd-9f26-4bf7-8bca-f7ce3eb54fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.500542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef1bd-9f26-4bf7-8bca-f7ce3eb54fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.500853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef1bd-9f26-4bf7-8bca-f7ce3eb54fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.501129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ef1bd-9f26-4bf7-8bca-f7ce3eb54fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.501861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ef1bd-9f26-4bf7-8bca-f7ce3eb54fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.503405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ef1bd-9f26-4bf7-8bca-f7ce3eb54fa9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.515016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 808/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.515016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.515016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.519193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.519288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 786/1594] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/3c7566543a6145b7b1a01612aff1c02a/users/41eb98b3a8434e7e9734eb747047a87d/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:48.523676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.542713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] MFA Rules not processed for user `6988a4385f3746cab807e36d5c515013`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:48.543947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:48.587879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac35524-0660-452d-8a97-32a7aef0508b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.592958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.593628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.593949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.594230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.594962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.596602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.607556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 787/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.608427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.611562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 809/1596] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:48.612412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.619114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b23e4-51e4-43c6-8b6c-ec3a423b62ae admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.623869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.624752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.625044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.625321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] PATH_INFO: `/v3/projects/a3499b45946141ff9177a6f3bbf01d3d/users/03102ea04c0e42b19576f1800f8cc6e9/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.629292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf685-d960-48f8-855c-b7e2da631a98 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.633889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.634553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.634960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.635108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.635848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.637472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.643020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3499b45946141ff9177a6f3bbf01d3d, user_id=03102ea04c0e42b19576f1800f8cc6e9, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.647381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.652719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 810/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:48.652719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.662867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b213-4925-48ca-aed0-e1468a980843 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.667639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.668430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.668716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.669000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] PATH_INFO: `/v3/projects/d55e2a4f35944f65bb0d5b1382b8cafc/users/ec4c5293e6a148a2a16ba4c3fc57a3a3/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.683700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55e2a4f35944f65bb0d5b1382b8cafc, user_id=ec4c5293e6a148a2a16ba4c3fc57a3a3, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.684778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:48.684778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:22:48.684778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:22:48.686785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.726438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 788/1598] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/a3499b45946141ff9177a6f3bbf01d3d/users/03102ea04c0e42b19576f1800f8cc6e9/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:48.727244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.789448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079ad91-42eb-4324-927d-91c33e06d020 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.794112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b46df-c7dd-4ae8-89e9-b77249c25aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.794995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b46df-c7dd-4ae8-89e9-b77249c25aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.795276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b46df-c7dd-4ae8-89e9-b77249c25aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.795549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b46df-c7dd-4ae8-89e9-b77249c25aa1 admin admin] PATH_INFO: `/v3/projects/2f5df9a6a9764dde96014824c7456331/users/787efd65008840748e98f9e46e11a1eb/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.805613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 811/1599] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/d55e2a4f35944f65bb0d5b1382b8cafc/users/ec4c5293e6a148a2a16ba4c3fc57a3a3/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:48.807729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.814873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b46df-c7dd-4ae8-89e9-b77249c25aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5df9a6a9764dde96014824c7456331, user_id=787efd65008840748e98f9e46e11a1eb, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.817712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b46df-c7dd-4ae8-89e9-b77249c25aa1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.869101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe998458-6861-4697-9930-dbd27b07e66d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.873781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b7d58-9d8d-4924-87ef-1f1b1ded7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:48.874724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7d58-9d8d-4924-87ef-1f1b1ded7230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.875011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7d58-9d8d-4924-87ef-1f1b1ded7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.875292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b7d58-9d8d-4924-87ef-1f1b1ded7230 admin admin] PATH_INFO: `/v3/projects/e44d493b7f594d46ae4381fc0eca1b74/users/c92737f153b2416d8ec9257dc7169ecb/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.884982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 789/1600] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/2f5df9a6a9764dde96014824c7456331/users/787efd65008840748e98f9e46e11a1eb/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:48.886383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.886602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.886886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.891853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b7d58-9d8d-4924-87ef-1f1b1ded7230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44d493b7f594d46ae4381fc0eca1b74, user_id=c92737f153b2416d8ec9257dc7169ecb, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:48.893262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:48.894909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b7d58-9d8d-4924-87ef-1f1b1ded7230 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:48.905430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:48.906703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:48.964238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 790/1601] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:48.965072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.975089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b140-cfe8-412b-b5be-2509ebdd9d21 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:48.978438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 812/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/e44d493b7f594d46ae4381fc0eca1b74/users/c92737f153b2416d8ec9257dc7169ecb/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:48.979834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c1a6-b4db-4229-9d09-0007ea03124b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:48.983805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c1a6-b4db-4229-9d09-0007ea03124b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:48.983805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80c1a6-b4db-4229-9d09-0007ea03124b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:48.983805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 813/1603] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jun 20 12:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:48.986935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80c1a6-b4db-4229-9d09-0007ea03124b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:48.993013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:49.032382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a097-2bae-4fb9-8381-c8fc4318bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.033305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a097-2bae-4fb9-8381-c8fc4318bc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.033589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a097-2bae-4fb9-8381-c8fc4318bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.033937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a097-2bae-4fb9-8381-c8fc4318bc4f admin admin] PATH_INFO: `/v3/projects/f268dd7b62204654baa5c376e0c63cd1/users/445e674d62ac4ade995d216f9d7be7b4/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.049085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a097-2bae-4fb9-8381-c8fc4318bc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f268dd7b62204654baa5c376e0c63cd1, user_id=445e674d62ac4ade995d216f9d7be7b4, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.051766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a097-2bae-4fb9-8381-c8fc4318bc4f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.055968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80c1a6-b4db-4229-9d09-0007ea03124b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.060525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d5a95-2cfc-4cf7-a333-53efba980ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.061215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5a95-2cfc-4cf7-a333-53efba980ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.061495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5a95-2cfc-4cf7-a333-53efba980ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.061773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d5a95-2cfc-4cf7-a333-53efba980ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.064038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d5a95-2cfc-4cf7-a333-53efba980ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.064301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d5a95-2cfc-4cf7-a333-53efba980ed0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.077363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 814/1604] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:49.077363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fa12-13f5-427a-90af-9d47868f356b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.077363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fa12-13f5-427a-90af-9d47868f356b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.077363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88fa12-13f5-427a-90af-9d47868f356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.095119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6c88fa12-13f5-427a-90af-9d47868f356b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.096330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6c88fa12-13f5-427a-90af-9d47868f356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.104552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 815/1605] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.105755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.106078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.106367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.124617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.125747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.128457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 791/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:48 2022] PUT /identity/v3/projects/f268dd7b62204654baa5c376e0c63cd1/users/445e674d62ac4ade995d216f9d7be7b4/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:49.130941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5e4a-1d88-477c-b7a1-17122bfd6995 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.130941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5e4a-1d88-477c-b7a1-17122bfd6995 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.130941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee5e4a-1d88-477c-b7a1-17122bfd6995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.156035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-51ee5e4a-1d88-477c-b7a1-17122bfd6995 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.157281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-51ee5e4a-1d88-477c-b7a1-17122bfd6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.195083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 816/1607] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.195950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.222852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 792/1608] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.224137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.224919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.225242 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.243521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.244749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.252271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a3b8-91f2-4b7f-8756-f2137b67b5d5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.256095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c8359-6026-4abb-8a76-885c9b95fa4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.256742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8359-6026-4abb-8a76-885c9b95fa4b service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.257052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8359-6026-4abb-8a76-885c9b95fa4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.257328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c8359-6026-4abb-8a76-885c9b95fa4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.266417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c8359-6026-4abb-8a76-885c9b95fa4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.267867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c8359-6026-4abb-8a76-885c9b95fa4b service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.270262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:49.278231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 817/1609] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:49.280140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.280140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.280140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.298486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.299548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.308637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 818/1610] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.315704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.318931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87255553-1b49-40f9-973f-7c5ea9108ba3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.323058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 793/1611] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.323514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.323947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.324402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.324687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.324967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] PATH_INFO: `/v3/projects/6bfc86c0ba8842759857b4348e82be90/users/b48ed9da69f948669752b3b7172071e1/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.335571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bd7b5-89e4-4f49-8950-4b70c5dd5113 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.339423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4e1c1-3175-4e4b-a74d-4c75428c7c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.340068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e1c1-3175-4e4b-a74d-4c75428c7c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.340349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e1c1-3175-4e4b-a74d-4c75428c7c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.340625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4e1c1-3175-4e4b-a74d-4c75428c7c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.341465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfc86c0ba8842759857b4348e82be90, user_id=b48ed9da69f948669752b3b7172071e1, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.344149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.351101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e1c1-3175-4e4b-a74d-4c75428c7c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.352533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4e1c1-3175-4e4b-a74d-4c75428c7c04 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.362294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 794/1612] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:49.363660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.363949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.364229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.393155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] MFA Rules not processed for user `445e674d62ac4ade995d216f9d7be7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.395858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.432048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 819/1613] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:49 2022] PUT /identity/v3/projects/6bfc86c0ba8842759857b4348e82be90/users/b48ed9da69f948669752b3b7172071e1/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:49.432048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.435842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:49.484232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 795/1614] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.485004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.495416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08958e-a1b0-4f1b-81ac-30328353aeb8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.499472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.500130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.500412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.500726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.504249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046abec-bd4c-46c9-b024-b6d4cad60de3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.509438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.510349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.510686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.516449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.580789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.582341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.590680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.592247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.595211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 796/1615] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:49.596062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.605324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 820/1616] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:49.605919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfccdb-6e83-49f7-801f-bae0fea6d130 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.607227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.610449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062f37c-2e2d-436b-9cd6-1fe4ac3ad334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.618610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f37c-2e2d-436b-9cd6-1fe4ac3ad334 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.618610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f37c-2e2d-436b-9cd6-1fe4ac3ad334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.618610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f37c-2e2d-436b-9cd6-1fe4ac3ad334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.623415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062f37c-2e2d-436b-9cd6-1fe4ac3ad334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.624878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062f37c-2e2d-436b-9cd6-1fe4ac3ad334 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.636561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 797/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:49.637409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.637697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.637991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.666748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] MFA Rules not processed for user `b48ed9da69f948669752b3b7172071e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:49.667977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:49.673410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:49.697401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f085251-688f-4e08-8f3b-22df7a20ed4a service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.702954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.704040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.704353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.704636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.743149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 798/1618] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:49.744166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.757305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a8050-e50f-49ae-80b6-3554b0f438e0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.762324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.762999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.763286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.763573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.764397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.766469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.766756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:49.780210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.782618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.792712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 821/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:49.809653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.809653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3534fa-4a56-4d50-81ef-816725487378 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:49.809653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:49.810212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:49.810212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:49.810405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:49.811137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:49.813049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:49.920289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 799/1620] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:49.921545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:49.937873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 822/1621] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:49.939699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.004555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10e02-017f-4d18-bfee-15e30636b93b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.051901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaef78-3d01-4fc2-8162-b100669bef6a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.057763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c5a52-92ac-46fc-974d-a7b5041314e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.058482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5a52-92ac-46fc-974d-a7b5041314e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.058770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5a52-92ac-46fc-974d-a7b5041314e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.059050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c5a52-92ac-46fc-974d-a7b5041314e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.059758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c5a52-92ac-46fc-974d-a7b5041314e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.061753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c5a52-92ac-46fc-974d-a7b5041314e4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.084754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ad6be-86d9-4e5f-abf3-b9f108f50ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.085573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad6be-86d9-4e5f-abf3-b9f108f50ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.085893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad6be-86d9-4e5f-abf3-b9f108f50ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.086341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ad6be-86d9-4e5f-abf3-b9f108f50ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.087074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ad6be-86d9-4e5f-abf3-b9f108f50ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.089187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ad6be-86d9-4e5f-abf3-b9f108f50ca4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.157500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 823/1622] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:50.157500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484385-55c2-4291-9aab-d1b77f82fd19 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.157500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484385-55c2-4291-9aab-d1b77f82fd19 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.157500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50484385-55c2-4291-9aab-d1b77f82fd19 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.158129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 824/1623] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jun 20 12:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:50.158848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484385-55c2-4291-9aab-d1b77f82fd19 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.171659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50484385-55c2-4291-9aab-d1b77f82fd19 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.176443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.177125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.178017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.178431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.179176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.180855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.190275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 800/1624] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:49 2022] POST /identity/v3/users => generated 292 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:50.193906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.194017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 825/1625] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:50.194106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.194106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.197008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.210710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879ec3-111e-455a-a015-e4f18cd18bd7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.213128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:50.214467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:50.216130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.216806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.217091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.217476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.218290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.220265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.233564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 826/1626] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:22:50.234259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.240413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:50.245146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec80d2-1e6a-45c2-a6df-9473bddc1885 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.253125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.254255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.254669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.254962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] PATH_INFO: `/v3/projects/53f4bd95e953454c81598cc848a03490/users/428cd59fbdcd45c091ded4fb06b7ae78/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.273026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f4bd95e953454c81598cc848a03490, user_id=428cd59fbdcd45c091ded4fb06b7ae78, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.281400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.315315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 801/1627] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:50.321602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.332336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a7b6-793d-4435-a7ad-fd25b9c20619 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.338239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.339237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.339595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.339941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] PATH_INFO: `/v3/projects/9339a2d9b61145b6b8d111c72c43d8d3/users/51ec638239a543d99625439e4dc12a8e/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.355697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9339a2d9b61145b6b8d111c72c43d8d3, user_id=51ec638239a543d99625439e4dc12a8e, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.358474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.402729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 827/1628] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:50 2022] PUT /identity/v3/projects/53f4bd95e953454c81598cc848a03490/users/428cd59fbdcd45c091ded4fb06b7ae78/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:50.403856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.474850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 802/1629] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:50 2022] PUT /identity/v3/projects/9339a2d9b61145b6b8d111c72c43d8d3/users/51ec638239a543d99625439e4dc12a8e/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:50.476534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.479234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42771e-829c-46a2-8b04-5642026a45fd admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.519101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:50.562394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.563326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c643dc-2379-4c45-a82d-968cd0341663 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.563716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.564512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.564922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.570907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.571803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.572436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.572911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.574014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.578619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.595582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 803/1630] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:50.598154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.615134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff9c55-32d4-4a50-bd0c-ed190026b788 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.621245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.622002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.622722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.623010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.623748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.626181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.644469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 804/1631] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:50.645246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.659643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e6a50-82a6-48da-99e9-6e1882b1420f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.664913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083404a5-fb32-454e-b56f-bdf62e62df5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.665873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083404a5-fb32-454e-b56f-bdf62e62df5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.666173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083404a5-fb32-454e-b56f-bdf62e62df5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.667080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083404a5-fb32-454e-b56f-bdf62e62df5e admin admin] PATH_INFO: `/v3/projects/53f4bd95e953454c81598cc848a03490/users/428cd59fbdcd45c091ded4fb06b7ae78/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.669286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083404a5-fb32-454e-b56f-bdf62e62df5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f4bd95e953454c81598cc848a03490, user_id=428cd59fbdcd45c091ded4fb06b7ae78, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.672351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083404a5-fb32-454e-b56f-bdf62e62df5e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.675759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.678499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.698560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 828/1632] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:50.699904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.715906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f930be-e6dc-482c-a2ab-c7b9a458c299 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:50.718446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 805/1633] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:50 2022] PUT /identity/v3/projects/53f4bd95e953454c81598cc848a03490/users/428cd59fbdcd45c091ded4fb06b7ae78/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:50.719602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.719902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.720183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.787678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] MFA Rules not processed for user `428cd59fbdcd45c091ded4fb06b7ae78`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:50.790093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:50.816233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba47924-2e50-44d0-a25f-aa59669fb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:50.816233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47924-2e50-44d0-a25f-aa59669fb526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.816233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47924-2e50-44d0-a25f-aa59669fb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.816233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba47924-2e50-44d0-a25f-aa59669fb526 admin admin] PATH_INFO: `/v3/projects/9339a2d9b61145b6b8d111c72c43d8d3/users/51ec638239a543d99625439e4dc12a8e/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.821748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba47924-2e50-44d0-a25f-aa59669fb526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9339a2d9b61145b6b8d111c72c43d8d3, user_id=51ec638239a543d99625439e4dc12a8e, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:50.829085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba47924-2e50-44d0-a25f-aa59669fb526 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:50.852540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 829/1634] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:50 2022] PUT /identity/v3/projects/9339a2d9b61145b6b8d111c72c43d8d3/users/51ec638239a543d99625439e4dc12a8e/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:50.866506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:50.866807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:50.867094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:50.880257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:50.903223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] MFA Rules not processed for user `51ec638239a543d99625439e4dc12a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:50.904851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:50.913574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 806/1635] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:50.924764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:50.974178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:51.011470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 830/1636] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:22:51.013885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe7ea8-3a35-40f7-9d2d-c9d3711deb82 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:51.134963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:51.135815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:51.136105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:51.136383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:51.228338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:51.229898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:51.240707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 807/1637] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:51.381715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:51.392328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406b67-0afc-46c0-9f04-c42dfcafc951 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:51.397068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb3426-b295-4522-8a37-d8de47371403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:51.397891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3426-b295-4522-8a37-d8de47371403 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:51.398355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3426-b295-4522-8a37-d8de47371403 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:51.398707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb3426-b295-4522-8a37-d8de47371403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:51.410588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb3426-b295-4522-8a37-d8de47371403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:51.413009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb3426-b295-4522-8a37-d8de47371403 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:51.443731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 831/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:51.569606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:51.579323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3cbb-755a-4660-b01b-e0d3b68c7898 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:51.588124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:51.589139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:51.591843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:51.592356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:51.685595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:51.707592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:51.710213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:51.730432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 808/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:52.313851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:52.314154 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:52.314440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:52.377677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:52.380263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] MFA Rules not processed for user `c92737f153b2416d8ec9257dc7169ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:52.380263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:52.392487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdf01-4055-4935-877f-12f5f2522b58 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:52.400083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a476a-f8ee-4b0a-b24d-a239b8cbd120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:52.403041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a476a-f8ee-4b0a-b24d-a239b8cbd120 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:52.404263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a476a-f8ee-4b0a-b24d-a239b8cbd120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:52.404651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a476a-f8ee-4b0a-b24d-a239b8cbd120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:52.534303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 832/1640] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:52.538783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:52.541843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a476a-f8ee-4b0a-b24d-a239b8cbd120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:52.547467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a476a-f8ee-4b0a-b24d-a239b8cbd120 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:52.572291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 809/1641] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:22:52.689790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db844a-2010-44b2-a4a7-bcf449b899c2 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:52.696612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:52.697856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:52.698356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:52.698878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:52.699813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:52.702276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:52.785174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8d66c-2f99-41db-b648-ea900a1e7d85 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:52.786288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8d66c-2f99-41db-b648-ea900a1e7d85 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:52.788786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8d66c-2f99-41db-b648-ea900a1e7d85 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:52.791060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 810/1642] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jun 20 12:22:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:52.804947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481a19-b2ed-438b-b81c-d50bde3c817d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:52.806090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481a19-b2ed-438b-b81c-d50bde3c817d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:52.806486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62481a19-b2ed-438b-b81c-d50bde3c817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:52.862671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 833/1643] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:22:52 2022] POST /identity/v3/projects => generated 405 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:22:52.866593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:52.887329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-62481a19-b2ed-438b-b81c-d50bde3c817d None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:52.890234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-62481a19-b2ed-438b-b81c-d50bde3c817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:53.005571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:53.035065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8fda9-aa2a-47f2-a94a-5d1fb5ee5fb4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:53.045947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:53.046657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.046946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.047229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.048052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:53.054449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:53.072144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 811/1644] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jun 20 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:53.075137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e45e-4e60-4d9f-833f-e8c71d3b4c99 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.079273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e45e-4e60-4d9f-833f-e8c71d3b4c99 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.079273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137e45e-4e60-4d9f-833f-e8c71d3b4c99 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.084136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 812/1645] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jun 20 12:22:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:53.090219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.091862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.092260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.137652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:53.138976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:53.160320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 834/1646] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:22:52 2022] POST /identity/v3/users => generated 309 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:22:53.164366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:53.177652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 813/1647] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:53.197155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e49eee-e7f2-4d62-9b2c-29e1b98c1df3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:53.197279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:53.206901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:53.207219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.207452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.207739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.214207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:53.217405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:53.269084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 835/1648] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:22:53.278054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:53.294727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638bed3-8920-478e-90c5-d5daba3608ac admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:53.305036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:53.306026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.306854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.307155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] PATH_INFO: `/v3/projects/458007e3698540e48139dea122b38b8e/users/9ac648ca69a94cce9adbd742e84a1d63/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.332246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=458007e3698540e48139dea122b38b8e, user_id=9ac648ca69a94cce9adbd742e84a1d63, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:53.336676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:53.358037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8c168-6bbe-4e0b-9628-2d276f1cdef3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:53.362392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:53.363190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.363486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.363769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.382695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:53.382695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:53.399714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 814/1649] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:22:53.436592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 836/1650] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:53 2022] PUT /identity/v3/projects/458007e3698540e48139dea122b38b8e/users/9ac648ca69a94cce9adbd742e84a1d63/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:53.440492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:53.466155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d442e-b32d-4b93-8472-ef9e6c1ff036 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:53.800435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:22:53.800435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63b813-792c-4049-bde7-f08152e234a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:53.800435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63b813-792c-4049-bde7-f08152e234a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.800435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63b813-792c-4049-bde7-f08152e234a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.807172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63b813-792c-4049-bde7-f08152e234a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.807172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63b813-792c-4049-bde7-f08152e234a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:53.807172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63b813-792c-4049-bde7-f08152e234a8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:53.807172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 815/1651] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:22:53.807888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:53.807888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c9621-9cd9-4d8f-881c-c8dda7f7f95b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:53.807888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:53.807888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:53.809835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:53.809835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] PATH_INFO: `/v3/projects/458007e3698540e48139dea122b38b8e/users/9ac648ca69a94cce9adbd742e84a1d63/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:53.809835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=458007e3698540e48139dea122b38b8e, user_id=9ac648ca69a94cce9adbd742e84a1d63, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:53.809835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:53.809835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 837/1652] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:22:53 2022] PUT /identity/v3/projects/458007e3698540e48139dea122b38b8e/users/9ac648ca69a94cce9adbd742e84a1d63/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:22:56.843184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f00f6-dce0-41e0-89e0-3f91bffd950e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:56.844108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f00f6-dce0-41e0-89e0-3f91bffd950e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:56.844556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f00f6-dce0-41e0-89e0-3f91bffd950e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:56.922029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f22f00f6-dce0-41e0-89e0-3f91bffd950e None None] MFA Rules not processed for user `9ac648ca69a94cce9adbd742e84a1d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:56.926704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f22f00f6-dce0-41e0-89e0-3f91bffd950e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:57.130858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 816/1653] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:59.281185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:22:59.425480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa4f08-d3a4-4e04-9ef6-d718281a3fd8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:22:59.439085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:22:59.440098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:59.440317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:59.440547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] PATH_INFO: `/v3/users/b48ed9da69f948669752b3b7172071e1` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:59.444151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48ed9da69f948669752b3b7172071e1)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:22:59.445211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: WARNING py.warnings [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:22:59.445211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: warnings.warn(msg) Jun 20 12:22:59.445211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: Jun 20 12:22:59.446468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:22:59.697710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a2894-99ee-484e-b5dd-f0b0816fd8d8 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:59.698190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a2894-99ee-484e-b5dd-f0b0816fd8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:59.698306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a2894-99ee-484e-b5dd-f0b0816fd8d8 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:59.700110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 817/1654] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:22:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:59.711109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e84a3-d27f-40b3-8eb5-cb6a7f02271a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:59.711396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e84a3-d27f-40b3-8eb5-cb6a7f02271a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:59.711679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e84a3-d27f-40b3-8eb5-cb6a7f02271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:59.747312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ba9e84a3-d27f-40b3-8eb5-cb6a7f02271a None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:22:59.748636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ba9e84a3-d27f-40b3-8eb5-cb6a7f02271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:22:59.758959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48ed9da69f948669752b3b7172071e1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:22:59.827224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48ed9da69f948669752b3b7172071e1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:22:59.955672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48ed9da69f948669752b3b7172071e1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:22:59.956330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48ed9da69f948669752b3b7172071e1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:22:59.956931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 818/1655] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:22:59.978166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91903f81-5aae-4237-bf74-f820151827cd None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:59.980565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91903f81-5aae-4237-bf74-f820151827cd None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:59.983864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91903f81-5aae-4237-bf74-f820151827cd None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:22:59.991045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 819/1656] 10.222.0.64 () {54 vars in 960 bytes} [Mon Jun 20 12:22:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:22:59.993461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:22:59.993958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:22:59.994386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:00.002063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20c96677-e2d0-41bc-be80-f4cb833187ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48ed9da69f948669752b3b7172071e1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:00.019813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:00.022913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:00.026336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 838/1657] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:22:59 2022] DELETE /identity/v3/users/b48ed9da69f948669752b3b7172071e1 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:00.031396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:00.031732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:00.032055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:00.071449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:00.076144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:00.099841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:00.115872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:00.239486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 820/1658] 10.222.0.64 () {58 vars in 1057 bytes} [Mon Jun 20 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:00.247357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:00.268544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 839/1659] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:00.272287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814fddb-a617-4aa6-8f64-feecc73d1465 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:00.289341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:00.290504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:00.291920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:00.293248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:00.298301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:00.312963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:00.316876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:00.336069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:00.340118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fc710-d5e7-460a-b94b-f9e68110b37e service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:00.365566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 821/1660] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:00.409098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2d99-9bfa-4383-b950-e0434089baa0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:00.414607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:00.415376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:00.415735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:00.416138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:00.427808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:00.429481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:00.441289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 840/1661] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:23:02.338713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:02.339622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:02.340166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:02.381693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:02.381693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:02.427926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952c6dc-d0c1-4e1e-88d6-0db597a77aa7 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:02.464794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:02.471422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:02.474639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:02.474941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] PATH_INFO: `/v3/users/c92737f153b2416d8ec9257dc7169ecb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:02.479463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] MFA Rules not processed for user `41eb98b3a8434e7e9734eb747047a87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:02.481350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:02.481770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92737f153b2416d8ec9257dc7169ecb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:02.511615 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:02.685153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 822/1662] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:02.686154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:02.687539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:02.718189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b314ac-d801-4cac-964a-b162bcd20a7f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:02.733096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:02.734022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:02.734313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:02.736855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] PATH_INFO: `/v3/projects/6bfc86c0ba8842759857b4348e82be90` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:02.738738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfc86c0ba8842759857b4348e82be90)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:02.741854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: WARNING py.warnings [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 12:23:02.741854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: warnings.warn(msg) Jun 20 12:23:02.741854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: Jun 20 12:23:02.743090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:02.752355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92737f153b2416d8ec9257dc7169ecb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:02.799197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92737f153b2416d8ec9257dc7169ecb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:02.891206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92737f153b2416d8ec9257dc7169ecb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:02.891862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92737f153b2416d8ec9257dc7169ecb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:02.904748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92737f153b2416d8ec9257dc7169ecb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:02.942239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 841/1663] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:02 2022] DELETE /identity/v3/users/c92737f153b2416d8ec9257dc7169ecb => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:02.942239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:02.948256 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:02.985787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfc86c0ba8842759857b4348e82be90', 'request_id': 'req-07c5365f-5d60-433a-b748-d256deb1ed28'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.013505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfc86c0ba8842759857b4348e82be90', 'request_id': 'req-07c5365f-5d60-433a-b748-d256deb1ed28'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.044428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfc86c0ba8842759857b4348e82be90', 'request_id': 'req-07c5365f-5d60-433a-b748-d256deb1ed28'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.051837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:03.166685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] The token cache is being invalidate because project 6bfc86c0ba8842759857b4348e82be90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:03.167046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.168626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.171654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 823/1664] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:02 2022] DELETE /identity/v3/projects/6bfc86c0ba8842759857b4348e82be90 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:03.175515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:03.177162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:03.177322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba7ef2-e727-4391-89d9-e4260a04d287 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:03.190742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:03.191429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:03.191718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:03.194631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:03.200755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:03.262839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:03.344991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5365f-5d60-433a-b748-d256deb1ed28 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:03.418417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:03.422131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:03.448366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 842/1665] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:03.511306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:03.512294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:03.513027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:03.513027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] PATH_INFO: `/v3/users/428cd59fbdcd45c091ded4fb06b7ae78` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:03.518233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428cd59fbdcd45c091ded4fb06b7ae78)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:03.531557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:03.742441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:03.744548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:03.763269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14520933-6300-45ac-b0a4-a7239571243c service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:03.769526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:03.771981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:03.772714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:03.773132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] PATH_INFO: `/v3/users/6988a4385f3746cab807e36d5c515013` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:03.777404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6988a4385f3746cab807e36d5c515013)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:03.781034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:03.797269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428cd59fbdcd45c091ded4fb06b7ae78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.826133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428cd59fbdcd45c091ded4fb06b7ae78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.844417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428cd59fbdcd45c091ded4fb06b7ae78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.846375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428cd59fbdcd45c091ded4fb06b7ae78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.848493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428cd59fbdcd45c091ded4fb06b7ae78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:03.933904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 824/1666] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:03 2022] DELETE /identity/v3/users/428cd59fbdcd45c091ded4fb06b7ae78 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:04.081721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6988a4385f3746cab807e36d5c515013'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.106835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:04.108542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:04.137451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6988a4385f3746cab807e36d5c515013'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.258644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae7f28-32c9-4972-acdd-eeb5605a5d99 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:04.263865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6988a4385f3746cab807e36d5c515013'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.264981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6988a4385f3746cab807e36d5c515013'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.268636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:04.273496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:04.273496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:04.273496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] PATH_INFO: `/v3/projects/e44d493b7f594d46ae4381fc0eca1b74` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:04.273496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44d493b7f594d46ae4381fc0eca1b74)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:04.279467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:04.281142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-76239616-5470-4b5e-ad2a-b67efcbd6da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6988a4385f3746cab807e36d5c515013'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.316519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 843/1667] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:03 2022] DELETE /identity/v3/users/6988a4385f3746cab807e36d5c515013 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:04.319868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:04.322889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:04.323059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:04.406874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:04.413053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:04.455050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44d493b7f594d46ae4381fc0eca1b74', 'request_id': 'req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.474887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44d493b7f594d46ae4381fc0eca1b74', 'request_id': 'req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.495819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44d493b7f594d46ae4381fc0eca1b74', 'request_id': 'req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.599685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] The token cache is being invalidate because project e44d493b7f594d46ae4381fc0eca1b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:04.603494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.605661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:04.608564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 825/1668] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:04 2022] DELETE /identity/v3/projects/e44d493b7f594d46ae4381fc0eca1b74 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:04.612542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 844/1669] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:04.616242 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:04.626870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:04.627243 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:04.629206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:04.663120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17bba1-1e18-40e9-b47a-6df8c5c3a20d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:04.689673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:04.689673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:04.689673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:04.689673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] PATH_INFO: `/v3/users/9ac648ca69a94cce9adbd742e84a1d63` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:04.693214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac648ca69a94cce9adbd742e84a1d63)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:04.696781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:04.765700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b63e2-2482-4491-8520-5e8f542f6895 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:04.771296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:04.773710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:04.774255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:04.775421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:04.783624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:04.827696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:04.829982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9b1c-d7c8-4d0c-bcb1-02eef55b3cda service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:04.874454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 845/1670] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:04.883343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:04.883686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:04.884022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:04.904697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:04.975689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] MFA Rules not processed for user `03102ea04c0e42b19576f1800f8cc6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:04.978795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:04.992027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac648ca69a94cce9adbd742e84a1d63'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:05.015842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac648ca69a94cce9adbd742e84a1d63'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:05.042794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac648ca69a94cce9adbd742e84a1d63'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:05.044813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac648ca69a94cce9adbd742e84a1d63'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:05.046683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-24c39d82-e60b-4746-89d5-eae1d3e77331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac648ca69a94cce9adbd742e84a1d63'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:05.120617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 826/1671] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:04 2022] DELETE /identity/v3/users/9ac648ca69a94cce9adbd742e84a1d63 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:05.143747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:05.186075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 846/1672] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:05.201736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:05.202289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:05.202795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:05.242229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] MFA Rules not processed for user `03102ea04c0e42b19576f1800f8cc6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:05.244268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:05.431612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 827/1673] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:05.445155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:05.448055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:05.644050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cab87-7818-4d6b-a9a5-90bff845fd22 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:05.826693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:05.827398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:05.827689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:05.827971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:05.850454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:05.861620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:05.889472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 847/1674] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:06.479990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:07.020660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:07.023853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:07.138319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:07.148892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c31b0-5c2b-4195-a7fd-4696fb2b8a59 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:07.161933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:07.162894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.163341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.163779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] PATH_INFO: `/v3/projects/53f4bd95e953454c81598cc848a03490` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:07.165556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f4bd95e953454c81598cc848a03490)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:07.170997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:07.192163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:07.194916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:07.228041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdaa00-17dc-4855-a264-ce9e022da5a0 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:07.241532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:07.242547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.242842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.243126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] PATH_INFO: `/v3/projects/458007e3698540e48139dea122b38b8e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:07.245313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=458007e3698540e48139dea122b38b8e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:07.247388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:07.381629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f4bd95e953454c81598cc848a03490', 'request_id': 'req-81af48c6-a724-4901-8ec3-8483cd6bb977'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.400543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f4bd95e953454c81598cc848a03490', 'request_id': 'req-81af48c6-a724-4901-8ec3-8483cd6bb977'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.420107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f4bd95e953454c81598cc848a03490', 'request_id': 'req-81af48c6-a724-4901-8ec3-8483cd6bb977'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.463910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458007e3698540e48139dea122b38b8e', 'request_id': 'req-d50f5c9f-7b64-4ed1-8562-816410626966'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.539121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] The token cache is being invalidate because project 53f4bd95e953454c81598cc848a03490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:07.539489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.540173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-81af48c6-a724-4901-8ec3-8483cd6bb977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.543408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 828/1675] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:07 2022] DELETE /identity/v3/projects/53f4bd95e953454c81598cc848a03490 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:07.544936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db65e-c00c-4019-a6a1-65ce1ad156a7 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.545652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db65e-c00c-4019-a6a1-65ce1ad156a7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.546967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db65e-c00c-4019-a6a1-65ce1ad156a7 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:07.548475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 829/1676] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jun 20 12:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:23:07.559467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1dcf-de38-4528-ba52-f7f0bf31299c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.559780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1dcf-de38-4528-ba52-f7f0bf31299c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.562841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee1dcf-de38-4528-ba52-f7f0bf31299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:07.621360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458007e3698540e48139dea122b38b8e', 'request_id': 'req-d50f5c9f-7b64-4ed1-8562-816410626966'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.642356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458007e3698540e48139dea122b38b8e', 'request_id': 'req-d50f5c9f-7b64-4ed1-8562-816410626966'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.674559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3cee1dcf-de38-4528-ba52-f7f0bf31299c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:07.686265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3cee1dcf-de38-4528-ba52-f7f0bf31299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:07.709501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] The token cache is being invalidate because project 458007e3698540e48139dea122b38b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:07.714047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.717176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d50f5c9f-7b64-4ed1-8562-816410626966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:07.720756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 848/1677] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:07 2022] DELETE /identity/v3/projects/458007e3698540e48139dea122b38b8e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:07.727570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.732879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.732879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:07.855342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:07.857631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:07.889965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 830/1678] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:07.892207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1f26-af77-402d-a86b-1f0a8d85da05 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.892495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1f26-af77-402d-a86b-1f0a8d85da05 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.893076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1f26-af77-402d-a86b-1f0a8d85da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:07.935247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-388b1f26-af77-402d-a86b-1f0a8d85da05 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:07.937575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-388b1f26-af77-402d-a86b-1f0a8d85da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:07.963952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 831/1679] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:07.971850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cde08-c2b3-4dc9-91ef-18b01a9ff780 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:07.971850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cde08-c2b3-4dc9-91ef-18b01a9ff780 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:07.971850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cde08-c2b3-4dc9-91ef-18b01a9ff780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.007601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 849/1680] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:08.017456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:08.024664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.052719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c96cde08-c2b3-4dc9-91ef-18b01a9ff780 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:08.059832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c96cde08-c2b3-4dc9-91ef-18b01a9ff780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.079292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48dd51-76f3-40c8-90c2-59504a914bc1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:08.097626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:08.099166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.102490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 832/1681] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:08.104421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.105934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] PATH_INFO: `/v3/projects/644e467d3892497a92a4c23fa12f6c03` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.107445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.108866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.110005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.111261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] RBAC: Authorizing `identity:delete_project(project_id=644e467d3892497a92a4c23fa12f6c03)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:08.118686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:08.154000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:08.177936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:08.181644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.210354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 833/1682] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:08.215034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:08.221246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.263030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fd7b7-f67b-4c33-8bde-0a9578c779e5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:08.273371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:08.275090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.276474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.277469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.295598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:08.299678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:08.363606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 834/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:08.371464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:08.399513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644e467d3892497a92a4c23fa12f6c03', 'request_id': 'req-0ba9cf39-600a-4511-87a4-64e267ede52f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:08.414641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8570f19-ce1b-43cc-a61b-580f84441744 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:08.520567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644e467d3892497a92a4c23fa12f6c03', 'request_id': 'req-0ba9cf39-600a-4511-87a4-64e267ede52f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:08.531482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644e467d3892497a92a4c23fa12f6c03', 'request_id': 'req-0ba9cf39-600a-4511-87a4-64e267ede52f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:08.557169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:08.558408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.558953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.566155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.566155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:08.566155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:08.566155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0871b-8562-478b-8158-8188f5f25418 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:08.582180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] The token cache is being invalidate because project 644e467d3892497a92a4c23fa12f6c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:08.582571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:08.585070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:08.592933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 850/1684] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:08 2022] DELETE /identity/v3/projects/644e467d3892497a92a4c23fa12f6c03 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:08.594745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:08.603038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.627028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 835/1685] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:23:08.627028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954d96-d7f9-4c7b-a482-eb7a7ec8590d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.627028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954d96-d7f9-4c7b-a482-eb7a7ec8590d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.628619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa954d96-d7f9-4c7b-a482-eb7a7ec8590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.651524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9cf39-600a-4511-87a4-64e267ede52f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:08.667189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:08.668069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.669878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.670495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.671603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:08.672051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:08.675837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67fd68-2ce0-4413-97a2-611e301c7471 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:08.714836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-fa954d96-d7f9-4c7b-a482-eb7a7ec8590d None None] MFA Rules not processed for user `787efd65008840748e98f9e46e11a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:08.717036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fa954d96-d7f9-4c7b-a482-eb7a7ec8590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.720741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 851/1686] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:23:08.723425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.724807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.725164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.827762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] MFA Rules not processed for user `ec4c5293e6a148a2a16ba4c3fc57a3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:08.832066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.851395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:08.867646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 836/1687] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:08.870938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.872495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.876078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.919942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:08.923152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.938158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 837/1688] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:08.939178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:08.941076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:08.960671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7db4d-7fbe-4c03-a1fd-e864241e2094 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:08.997465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:08.998318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:08.998488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:08.998761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:08.999490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.001491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.099086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 838/1689] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:08 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:09.100225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.208130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f249a9-e5ec-48cc-a254-735456579d14 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.220954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc0481-b54e-46c3-ae8e-49bc472bc11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.221647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0481-b54e-46c3-ae8e-49bc472bc11f admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.222177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0481-b54e-46c3-ae8e-49bc472bc11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.222336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc0481-b54e-46c3-ae8e-49bc472bc11f admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.226746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc0481-b54e-46c3-ae8e-49bc472bc11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.235075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc0481-b54e-46c3-ae8e-49bc472bc11f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.242459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 852/1690] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:09.243836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.253170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:09.330189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 839/1691] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:09 2022] POST /identity/v3/projects => generated 361 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:09.342697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.343641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.343641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.378496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:09.381398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:09.405712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e41cfe-fb0c-43c2-8533-7d7b5436ff43 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.428268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:09.524672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 840/1692] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:09.531307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.533238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa6f65-bd80-4234-a61d-e414062f415c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.534023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6f65-bd80-4234-a61d-e414062f415c service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.534388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6f65-bd80-4234-a61d-e414062f415c service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.534747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa6f65-bd80-4234-a61d-e414062f415c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.546822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02faf-8b6d-40ae-abdb-301918cf6499 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.556060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.558569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.559006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.559579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.560433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.562568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.624280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6f65-bd80-4234-a61d-e414062f415c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.630803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa6f65-bd80-4234-a61d-e414062f415c service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.636855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 853/1693] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:09.638157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.638455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.638715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.657286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] MFA Rules not processed for user `ec4c5293e6a148a2a16ba4c3fc57a3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:09.659031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:09.671086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 841/1694] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:09 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:09.672050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.690549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96fa1-a61a-4770-a69a-bfa30457f31c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.696900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.698726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.699421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.699716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.700433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.702741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.735538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 854/1695] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:09.739832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.742457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:09.814698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 842/1696] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:09 2022] POST /identity/v3/users => generated 281 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:09.814698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.849054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc264d4-764a-4b98-9a02-cdc6541c2fac admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.868983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.869397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.870034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.871495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.874319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:09.875141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.876951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fb1a1-638f-495c-b50d-2631d6205642 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.879062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.893262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.893989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.894342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.894640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.904230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 843/1697] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:23:09.905393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.908561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:09.919035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0183a5-6e43-4d76-81f6-1becb96d9f1f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:09.934432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:09.935816 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:09.935950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.936116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:09.936552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:09.937139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:09.937540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.938846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:09.964657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 855/1698] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:09.965463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:09.968516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:09.980785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:09.982837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 844/1699] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:09.985925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.006632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92ccf6-bbac-45ed-b57a-7874aed4a77b service placement] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.019297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.020232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.020601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.020944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.046826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.046826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.055857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afc532-5549-44e5-b33a-e928b80c11df admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.081784 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 856/1700] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:10.081784 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.089024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.091876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.091876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.091876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.091876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.097583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.104521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e5e24-2c34-4139-a3fa-f2109bdd4a95 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.117519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.118238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.118521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.120601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.120601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.124482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.137934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 845/1701] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:10.137934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.174430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87e7b-9e38-47f1-9fd2-eae503a13529 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.190145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.190145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.190145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.190145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.190441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.193215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.232260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 846/1702] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:10.233966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.257620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fcd89-549d-4fa2-88bb-164e24acee23 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.264418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.265420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.265907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.276273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.276273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.276273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.276923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 857/1703] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:10 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:10.276923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.296641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 847/1704] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:10.298544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.319728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431888-ff1f-41ab-ad89-cc173e343d6e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.498857 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:10.586652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc419-fd32-4a08-88dc-12a087b4b5aa admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:10.587369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.596331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.596331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.596331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.596331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.602783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.615693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:10.618882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:10.619174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:10.619458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] PATH_INFO: `/v3/projects/a67c0ba8ec684fd796395f5e28a2c505/users/fc09c3d14c104762abe0b88841ce7f2b/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:10.661600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a67c0ba8ec684fd796395f5e28a2c505, user_id=fc09c3d14c104762abe0b88841ce7f2b, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:10.669155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:10.749831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 848/1705] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:10 2022] POST /identity/v3/users => generated 284 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:10.749831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.778553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:10.778862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 858/1706] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:10 2022] PUT /identity/v3/projects/a67c0ba8ec684fd796395f5e28a2c505/users/fc09c3d14c104762abe0b88841ce7f2b/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:10.779820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:10.792649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4aef-5fdb-4d8e-8b71-13d3edb1e7c7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:11.034249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:11.035229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.035750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.035874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] PATH_INFO: `/v3/projects/95ab40568c5b4f52bf29a8c121869c3e/users/923b7b6d888144558c2a0637b655918b/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.059591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eac55a-83b4-4c6d-8ff1-0647e2bb9af3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:11.091618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7194be-356b-4ef7-bde6-0eefae034ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:11.092989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7194be-356b-4ef7-bde6-0eefae034ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.093274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7194be-356b-4ef7-bde6-0eefae034ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.094759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7194be-356b-4ef7-bde6-0eefae034ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.097382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7194be-356b-4ef7-bde6-0eefae034ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:11.102383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7194be-356b-4ef7-bde6-0eefae034ac2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:11.107980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ab40568c5b4f52bf29a8c121869c3e, user_id=923b7b6d888144558c2a0637b655918b, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:11.111006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:11.129094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 859/1707] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:11.131783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a386f-fe5c-4bcf-985a-f9ae5e7f9312 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.132074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a386f-fe5c-4bcf-985a-f9ae5e7f9312 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.136227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a386f-fe5c-4bcf-985a-f9ae5e7f9312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.209973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-257a386f-fe5c-4bcf-985a-f9ae5e7f9312 None None] MFA Rules not processed for user `fc09c3d14c104762abe0b88841ce7f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:11.211963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-257a386f-fe5c-4bcf-985a-f9ae5e7f9312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:11.230614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:11.254496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 849/1708] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:10 2022] PUT /identity/v3/projects/95ab40568c5b4f52bf29a8c121869c3e/users/923b7b6d888144558c2a0637b655918b/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:11.256258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:11.400037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 860/1709] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:11.402047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.403798 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.404225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.463397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976ab81-5510-4425-b12f-c6cd893cc015 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:11.472712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:11.474592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.474967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.475440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.479781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:11.482238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] MFA Rules not processed for user `923b7b6d888144558c2a0637b655918b`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:11.483878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:11.486867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:11.507068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 850/1710] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:11.521393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:11.553311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0a84d-3beb-4b88-930e-cbb4a2dfbce4 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:11.583584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57eb6-edce-414d-bfda-bb3bdb786b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:11.584284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57eb6-edce-414d-bfda-bb3bdb786b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.584572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57eb6-edce-414d-bfda-bb3bdb786b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.584860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57eb6-edce-414d-bfda-bb3bdb786b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.588095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57eb6-edce-414d-bfda-bb3bdb786b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:11.595509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57eb6-edce-414d-bfda-bb3bdb786b46 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:11.710677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 861/1711] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:11.712259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:11.735753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 851/1712] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:11 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:11.738614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.739787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.740079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:11.766656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f59bda-b97b-4f1d-b90c-bb9736f7cc23 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:11.815414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] MFA Rules not processed for user `41eb98b3a8434e7e9734eb747047a87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:11.816699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:11.967540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:11.984906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:11.986333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:11.986464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:11.986772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] PATH_INFO: `/v3/projects/3f8ed3fe115f40309671a54d1003bc76/users/52bc9cfa43dd4221bae60c1c0fd797e2/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:12.034072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8ed3fe115f40309671a54d1003bc76, user_id=52bc9cfa43dd4221bae60c1c0fd797e2, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:12.041493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:12.089479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 852/1713] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:12.090891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:12.148444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01c4b0-a92f-4dc2-b169-4c6d93f05f3b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:12.157385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 862/1714] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:11 2022] PUT /identity/v3/projects/3f8ed3fe115f40309671a54d1003bc76/users/52bc9cfa43dd4221bae60c1c0fd797e2/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:12.162605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:12.282890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:12.348318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fe5a6-d317-453e-9532-b88abf8d04e8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:12.361337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15affb8b-9572-479b-b288-953118408965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:12.364095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15affb8b-9572-479b-b288-953118408965 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:12.365979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15affb8b-9572-479b-b288-953118408965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:12.366985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15affb8b-9572-479b-b288-953118408965 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:12.368737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15affb8b-9572-479b-b288-953118408965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:12.372570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15affb8b-9572-479b-b288-953118408965 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:12.418243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e5f99-f745-46f9-84cb-45089a70fa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:12.428985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e5f99-f745-46f9-84cb-45089a70fa6a admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:12.430122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e5f99-f745-46f9-84cb-45089a70fa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:12.430561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e5f99-f745-46f9-84cb-45089a70fa6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:12.432123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e5f99-f745-46f9-84cb-45089a70fa6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:12.434469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e5f99-f745-46f9-84cb-45089a70fa6a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:12.514339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 863/1715] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:12 2022] POST /identity/v3/users => generated 300 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:12.515743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:12.516040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:12.516329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:12.564594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 853/1716] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:12 2022] POST /identity/v3/projects => generated 365 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:12.567022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:12.569159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:12.570341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:12.594706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] MFA Rules not processed for user `52bc9cfa43dd4221bae60c1c0fd797e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:12.605319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:12.648491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] MFA Rules not processed for user `ec4c5293e6a148a2a16ba4c3fc57a3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:12.652680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:12.771888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 864/1717] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:12.772877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:12.821866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 854/1718] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:12.823113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:12.944403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311b7b3-5a29-465b-a3b0-d4fc8e0e6c3a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:12.969904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:12.970549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:12.970838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:12.971237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:12.974160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:12.974160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:12.997019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 865/1719] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:12.998194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.003288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:13.018389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb41178-fd09-4783-916d-b06708cb21f9 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.026271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.027524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.027997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.031528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.032099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.034687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.122936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:13.151228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb75e49-2176-4109-a71d-8422416cbdf9 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.158394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.159089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.159379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.159662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.167156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 855/1720] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:12 2022] POST /identity/v3/users => generated 289 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:13.168080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.182849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.186497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.187993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:13.197623 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7542-928f-4ef3-95b6-167ee0ac653e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.205393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.209409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.209409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.209409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] PATH_INFO: `/v3/projects/97c4903b16e742d0a15cf76648df6ef5/users/e679c6ca21d44eb09c076f6dc06e3cbf/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.219457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 866/1721] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:13.220347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.256015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2fb2e-8d3f-4ef7-bc33-884b7d43b68f service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.257899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c4903b16e742d0a15cf76648df6ef5, user_id=e679c6ca21d44eb09c076f6dc06e3cbf, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.260983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.279780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.284004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.284004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.284004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.284004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.284004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.318060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 867/1722] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:13.319286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.355500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37570b-a72d-4da7-a57c-f76a596e09f3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.366945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 856/1723] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:13 2022] PUT /identity/v3/projects/97c4903b16e742d0a15cf76648df6ef5/users/e679c6ca21d44eb09c076f6dc06e3cbf/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:13.371266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb407108-9c95-4578-bf30-f0529ccc27f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.371504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.374361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb407108-9c95-4578-bf30-f0529ccc27f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.374879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb407108-9c95-4578-bf30-f0529ccc27f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.375567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb407108-9c95-4578-bf30-f0529ccc27f0 admin admin] PATH_INFO: `/v3/projects/e20672b71e084973928cc3f6e7cc84b3/users/2b0e7046b864424e8b680c61a49e8bb8/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.435903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb407108-9c95-4578-bf30-f0529ccc27f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20672b71e084973928cc3f6e7cc84b3, user_id=2b0e7046b864424e8b680c61a49e8bb8, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.441315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb407108-9c95-4578-bf30-f0529ccc27f0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.515689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74efe517-087e-43d3-84fb-d2241c314c76 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.522419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faa4b9-150c-480a-ae27-141416bb28fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.523583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa4b9-150c-480a-ae27-141416bb28fb admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.524056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa4b9-150c-480a-ae27-141416bb28fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.524539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa4b9-150c-480a-ae27-141416bb28fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.525491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faa4b9-150c-480a-ae27-141416bb28fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.527651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faa4b9-150c-480a-ae27-141416bb28fb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.544138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 857/1724] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:13.546033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e39833-12d7-42a0-a9f9-fdfeb7dbf13e None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.546143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e39833-12d7-42a0-a9f9-fdfeb7dbf13e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.546417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e39833-12d7-42a0-a9f9-fdfeb7dbf13e None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.548632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 858/1725] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jun 20 12:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:23:13.548834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e39833-12d7-42a0-a9f9-fdfeb7dbf13e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.560801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 868/1726] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:13 2022] PUT /identity/v3/projects/e20672b71e084973928cc3f6e7cc84b3/users/2b0e7046b864424e8b680c61a49e8bb8/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:13.563191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc7b52-5182-4cf0-ad10-474720396a67 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.564086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e39833-12d7-42a0-a9f9-fdfeb7dbf13e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.564501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc7b52-5182-4cf0-ad10-474720396a67 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.565230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc7b52-5182-4cf0-ad10-474720396a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.617255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-7abc7b52-5182-4cf0-ad10-474720396a67 None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:13.620041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7abc7b52-5182-4cf0-ad10-474720396a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:13.658668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.660757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.663078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.663078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] PATH_INFO: `/v3/projects/97c4903b16e742d0a15cf76648df6ef5/users/e679c6ca21d44eb09c076f6dc06e3cbf/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.664770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c4903b16e742d0a15cf76648df6ef5, user_id=e679c6ca21d44eb09c076f6dc06e3cbf, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.667723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.709285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 859/1727] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:13 2022] PUT /identity/v3/projects/97c4903b16e742d0a15cf76648df6ef5/users/e679c6ca21d44eb09c076f6dc06e3cbf/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:13.709285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.777323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 869/1728] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:13.779432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.779948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.780307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.844071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] MFA Rules not processed for user `e679c6ca21d44eb09c076f6dc06e3cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:13.846851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:13.898909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19be0d-d74f-4999-872f-492b9cf44573 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:13.915700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:13.916397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:13.919229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:13.919552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:13.922357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:13.928478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:13.959379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 860/1729] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:13.962718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:13.963851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:13.978136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:14.030532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 870/1730] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:14.032516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:14.056218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344addf-aa38-4d21-8323-0e997edee8c3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:14.074725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa71fae-f57c-40be-a6a0-584724daef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:14.082734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa71fae-f57c-40be-a6a0-584724daef41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:14.084904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa71fae-f57c-40be-a6a0-584724daef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:14.085431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa71fae-f57c-40be-a6a0-584724daef41 admin admin] PATH_INFO: `/v3/projects/e20672b71e084973928cc3f6e7cc84b3/users/2b0e7046b864424e8b680c61a49e8bb8/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:14.090802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa71fae-f57c-40be-a6a0-584724daef41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20672b71e084973928cc3f6e7cc84b3, user_id=2b0e7046b864424e8b680c61a49e8bb8, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:14.097275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa71fae-f57c-40be-a6a0-584724daef41 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:14.135644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa9c7-6970-48d2-a4d6-6304a14bc4ae admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:14.141329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:14.142033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:14.142322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:14.142859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:14.149416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 871/1731] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:14 2022] PUT /identity/v3/projects/e20672b71e084973928cc3f6e7cc84b3/users/2b0e7046b864424e8b680c61a49e8bb8/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:14.153231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:14.154948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:14.160686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:14.161253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:14.161638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:14.169575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 861/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:14.219988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] MFA Rules not processed for user `2b0e7046b864424e8b680c61a49e8bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:14.223170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:14.324114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:14.508342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 872/1733] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:14.514704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:14.853187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92b3c3-df29-43f6-baac-a6b23084817b service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:15.169871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facde21-2ae9-424e-804c-8a8a1ef7551c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:15.173982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facde21-2ae9-424e-804c-8a8a1ef7551c service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:15.174527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facde21-2ae9-424e-804c-8a8a1ef7551c service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:15.177535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facde21-2ae9-424e-804c-8a8a1ef7551c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:15.262579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:15.264651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:15.306392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65802a-b287-4b2f-919f-d74a011e17bf None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:15.341131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:15.350070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:15.350418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:15.350711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:15.352733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facde21-2ae9-424e-804c-8a8a1ef7551c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:15.354436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facde21-2ae9-424e-804c-8a8a1ef7551c service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:15.370504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:15.391838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 862/1734] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:15.392246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:15.423424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 873/1735] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:15.814612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:15.814612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:15.814612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:15.896904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:15.898251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:15.928519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:15.941067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3fe84-0b15-4ad3-a540-ae64d48125e6 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:15.946625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:15.953306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558d9b0-6579-43ad-8500-a330d1371b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:15.954506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d9b0-6579-43ad-8500-a330d1371b86 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:15.954970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d9b0-6579-43ad-8500-a330d1371b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:15.955668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558d9b0-6579-43ad-8500-a330d1371b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:16.097775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558d9b0-6579-43ad-8500-a330d1371b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:16.101228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558d9b0-6579-43ad-8500-a330d1371b86 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:16.115864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 863/1736] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:16.140287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 874/1737] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:23:16.562240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:16.564014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:16.759039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e9559-985a-4050-8f81-eef07c94890c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:16.790561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2c95-6487-4310-ac01-e587b1c5b654 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:16.791287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2c95-6487-4310-ac01-e587b1c5b654 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:16.791586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2c95-6487-4310-ac01-e587b1c5b654 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:16.791870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2c95-6487-4310-ac01-e587b1c5b654 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:16.835177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2c95-6487-4310-ac01-e587b1c5b654 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:16.838091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2c95-6487-4310-ac01-e587b1c5b654 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:16.862145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 864/1738] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:23:17.448094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:17.449162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:17.449656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:17.514172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] MFA Rules not processed for user `787efd65008840748e98f9e46e11a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:17.521339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:17.700789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 875/1739] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:18.456935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:18.456935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:18.456935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:18.456935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:18.456935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:18.456935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 865/1740] 10.222.0.72 () {58 vars in 1015 bytes} [Mon Jun 20 12:23:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:18.460305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:18.460305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:18.460305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cefeaa-8d68-4c61-a5cb-f71273c567bf None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:18.471330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3603510-dc4a-4c30-9e96-f3202ae88c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:18.473391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603510-dc4a-4c30-9e96-f3202ae88c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:18.473684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603510-dc4a-4c30-9e96-f3202ae88c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:18.474001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3603510-dc4a-4c30-9e96-f3202ae88c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:18.491957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3603510-dc4a-4c30-9e96-f3202ae88c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:18.497404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3603510-dc4a-4c30-9e96-f3202ae88c55 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:18.530472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 876/1741] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:19.120044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:19.252985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:19.267467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876221f-ae1d-4e15-aa4f-3b226496e3b8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:19.287111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:19.289016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:19.289894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:19.290664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] PATH_INFO: `/v3/users/fc09c3d14c104762abe0b88841ce7f2b` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:19.292896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc09c3d14c104762abe0b88841ce7f2b)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:19.295411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:19.686773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc09c3d14c104762abe0b88841ce7f2b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:19.796146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc09c3d14c104762abe0b88841ce7f2b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:19.879371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc09c3d14c104762abe0b88841ce7f2b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:19.884540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc09c3d14c104762abe0b88841ce7f2b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:19.890646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc09c3d14c104762abe0b88841ce7f2b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:20.024847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 866/1742] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:19 2022] DELETE /identity/v3/users/fc09c3d14c104762abe0b88841ce7f2b => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:20.032846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:20.033430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:20.033526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:20.085715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:20.089952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:20.250887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:20.330601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 877/1743] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:20.487512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:20.490239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:20.663270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f31f0-fab5-4f63-a1c7-543af335b9f3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:20.690236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df103-b09a-4264-ba93-ae25a9b2dbb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:20.690236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df103-b09a-4264-ba93-ae25a9b2dbb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:20.694507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df103-b09a-4264-ba93-ae25a9b2dbb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:20.694507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df103-b09a-4264-ba93-ae25a9b2dbb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:20.709184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629df103-b09a-4264-ba93-ae25a9b2dbb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:20.712138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629df103-b09a-4264-ba93-ae25a9b2dbb3 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:20.759083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 867/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:21.600476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:21.604731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:21.623836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d75eb-098b-40fc-84c9-9eb7cfe2af90 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:21.646091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:21.647049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:21.647335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:21.647613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] PATH_INFO: `/v3/users/923b7b6d888144558c2a0637b655918b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:21.653194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923b7b6d888144558c2a0637b655918b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:21.657471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:21.775100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd836f-fee2-4c69-80cc-a47ed20caf3d None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:21.775639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd836f-fee2-4c69-80cc-a47ed20caf3d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:21.775639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd836f-fee2-4c69-80cc-a47ed20caf3d None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:21.781155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 868/1745] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:23:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:23:21.793511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed06e8-db8e-419c-81fd-8b11c8119534 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:21.793819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed06e8-db8e-419c-81fd-8b11c8119534 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:21.794142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed06e8-db8e-419c-81fd-8b11c8119534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:21.833698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b0ed06e8-db8e-419c-81fd-8b11c8119534 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:21.835139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b0ed06e8-db8e-419c-81fd-8b11c8119534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:21.965696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923b7b6d888144558c2a0637b655918b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:22.019211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923b7b6d888144558c2a0637b655918b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:22.092164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923b7b6d888144558c2a0637b655918b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:22.093544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923b7b6d888144558c2a0637b655918b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:22.110842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923b7b6d888144558c2a0637b655918b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:22.132761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 869/1746] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:22.147862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:22.148404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:22.149033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:22.150692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 878/1747] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:21 2022] DELETE /identity/v3/users/923b7b6d888144558c2a0637b655918b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:22.186382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:22.187829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:22.216160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:22.409450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 870/1748] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:22.447310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:22.448795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:22.599706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3767d8-c213-49bf-89cb-6331e53201b3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:22.630223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:22.630902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:22.631839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:22.632128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:22.632418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:22.632701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:22.669470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:22.671728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:22.703461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 879/1749] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:22.783682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845a5fc-eb11-4855-afc3-85e8f1f012f2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:22.792728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:22.793713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:22.794187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:22.794631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:22.814374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:22.815743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:22.819027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:22.840498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:22.842345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:22.842779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad17e-27fd-4469-9326-57b58c7deff6 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:22.864852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:22.866444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:22.866972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:22.867585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] PATH_INFO: `/v3/projects/a67c0ba8ec684fd796395f5e28a2c505` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:22.876602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a67c0ba8ec684fd796395f5e28a2c505)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:22.880739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:22.941188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 871/1750] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:23.077930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:23.094624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67c0ba8ec684fd796395f5e28a2c505', 'request_id': 'req-0cefce2c-a221-4ba7-8157-d6e35ee998b2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.199842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67c0ba8ec684fd796395f5e28a2c505', 'request_id': 'req-0cefce2c-a221-4ba7-8157-d6e35ee998b2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.213198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67c0ba8ec684fd796395f5e28a2c505', 'request_id': 'req-0cefce2c-a221-4ba7-8157-d6e35ee998b2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.289464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] The token cache is being invalidate because project a67c0ba8ec684fd796395f5e28a2c505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:23.289464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.289464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0cefce2c-a221-4ba7-8157-d6e35ee998b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.291977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 880/1751] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:22 2022] DELETE /identity/v3/projects/a67c0ba8ec684fd796395f5e28a2c505 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:23.297492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:23.344926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dc45b-4f08-4269-9c7c-3fe7d9b3f463 service nova] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:23.552967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:23.554549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:23.554836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:23.555112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] PATH_INFO: `/v3/users/e679c6ca21d44eb09c076f6dc06e3cbf` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:23.557263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e679c6ca21d44eb09c076f6dc06e3cbf)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:23.560646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:23.799244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:23.830508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e679c6ca21d44eb09c076f6dc06e3cbf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.924389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e679c6ca21d44eb09c076f6dc06e3cbf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.944268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e679c6ca21d44eb09c076f6dc06e3cbf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.946431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e679c6ca21d44eb09c076f6dc06e3cbf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:23.948590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e679c6ca21d44eb09c076f6dc06e3cbf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:24.048868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 872/1752] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:23 2022] DELETE /identity/v3/users/e679c6ca21d44eb09c076f6dc06e3cbf => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:24.091713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0541-6c12-4865-b3c9-3ae414e48ba3 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:24.092583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0541-6c12-4865-b3c9-3ae414e48ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:24.093011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced0541-6c12-4865-b3c9-3ae414e48ba3 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:24.095480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 881/1753] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:23:24.225904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:24.226680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:24.228348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:24.228729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:24.229269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:24.265654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:24.269668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:24.373680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a13d95-5944-4b64-822b-127a18b67cd3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:24.380598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:24.382036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:24.382478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:24.382915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] PATH_INFO: `/v3/projects/95ab40568c5b4f52bf29a8c121869c3e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:24.385390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ab40568c5b4f52bf29a8c121869c3e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:24.388648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:24.436298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 882/1754] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:23:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:24.540846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ab40568c5b4f52bf29a8c121869c3e', 'request_id': 'req-b5c12b98-e52a-4ec9-bca5-627429d7d614'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:24.553744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ab40568c5b4f52bf29a8c121869c3e', 'request_id': 'req-b5c12b98-e52a-4ec9-bca5-627429d7d614'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:24.562430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ab40568c5b4f52bf29a8c121869c3e', 'request_id': 'req-b5c12b98-e52a-4ec9-bca5-627429d7d614'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:24.641763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:24.643779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:24.673552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] The token cache is being invalidate because project 95ab40568c5b4f52bf29a8c121869c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:24.674607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:24.677576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:24.680479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 873/1755] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:24 2022] DELETE /identity/v3/projects/95ab40568c5b4f52bf29a8c121869c3e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:24.684920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:24.689050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:24.692888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc071cc-3eef-40b8-beeb-326e51be9b60 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:24.834834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:24.883179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12b98-e52a-4ec9-bca5-627429d7d614 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:24.892990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:24.896853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:24.897039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:24.897188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:24.901155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:24.902717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:24.904306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:24.904306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] PATH_INFO: `/v3/users/2b0e7046b864424e8b680c61a49e8bb8` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:24.906829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:24.907953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0e7046b864424e8b680c61a49e8bb8)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:24.912709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:24.941769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:24.944372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:24.980317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 883/1756] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:23:25.163829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0e7046b864424e8b680c61a49e8bb8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:25.193139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0e7046b864424e8b680c61a49e8bb8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:25.211518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0e7046b864424e8b680c61a49e8bb8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:25.212411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0e7046b864424e8b680c61a49e8bb8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:25.213183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0e7046b864424e8b680c61a49e8bb8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:25.371750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 874/1757] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:24 2022] DELETE /identity/v3/users/2b0e7046b864424e8b680c61a49e8bb8 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:27.164170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:27.169119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:27.204255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3ec2f-4278-403c-b8f4-b8bed3d0d793 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:27.318329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:27.333623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:27.334957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:27.335237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:27.335570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] PATH_INFO: `/v3/projects/97c4903b16e742d0a15cf76648df6ef5` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:27.336986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c4903b16e742d0a15cf76648df6ef5)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:27.339117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:27.513535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c4903b16e742d0a15cf76648df6ef5', 'request_id': 'req-aa5161dd-017c-4735-81b8-9c5883b3f49e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:27.669601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c4903b16e742d0a15cf76648df6ef5', 'request_id': 'req-aa5161dd-017c-4735-81b8-9c5883b3f49e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:27.677213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c4903b16e742d0a15cf76648df6ef5', 'request_id': 'req-aa5161dd-017c-4735-81b8-9c5883b3f49e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:27.701093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:27.702622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:27.704524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] The token cache is being invalidate because project 97c4903b16e742d0a15cf76648df6ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:27.705152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:27.706127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa5161dd-017c-4735-81b8-9c5883b3f49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:27.710007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 884/1758] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:27 2022] DELETE /identity/v3/projects/97c4903b16e742d0a15cf76648df6ef5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:27.721895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084564f-2ae2-423c-bfb3-7e314fc7317a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:27.722195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084564f-2ae2-423c-bfb3-7e314fc7317a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:27.722519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084564f-2ae2-423c-bfb3-7e314fc7317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:27.740726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288071-43ac-4eb9-bd71-8401781ec7c6 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:27.747240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4084564f-2ae2-423c-bfb3-7e314fc7317a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:27.748976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4084564f-2ae2-423c-bfb3-7e314fc7317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:27.844287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 885/1759] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:27.845927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:27.846314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:27.846670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:27.865779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:27.865779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:27.865779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:27.865779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] PATH_INFO: `/v3/projects/e20672b71e084973928cc3f6e7cc84b3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:27.874508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20672b71e084973928cc3f6e7cc84b3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:27.877046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:27.886750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:27.888105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:27.919219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 886/1760] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:27.923246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:27.939148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c8fa2-8968-427d-ba85-03dad0666bfc None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:27.955526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:27.956297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:27.956692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:27.957125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:27.958138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:27.958809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:27.960799 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:27.982530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 887/1761] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:23:27.983660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:27.996491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3907-8e16-4df4-9f87-63fee28dca1b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.013762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.016018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.017127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.017956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.021042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.022765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.039264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20672b71e084973928cc3f6e7cc84b3', 'request_id': 'req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:28.050659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20672b71e084973928cc3f6e7cc84b3', 'request_id': 'req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:28.063332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20672b71e084973928cc3f6e7cc84b3', 'request_id': 'req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:28.080593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:28.220816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 888/1762] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:27 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:28.222571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.239805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] The token cache is being invalidate because project e20672b71e084973928cc3f6e7cc84b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:28.240113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:28.240791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-fbbed155-3e7e-4d43-b65f-f0d3ccd2f940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:28.242400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 875/1763] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:27 2022] DELETE /identity/v3/projects/e20672b71e084973928cc3f6e7cc84b3 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:28.247834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681592-9986-4a0e-84a4-cd50a11ed17d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.248321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681592-9986-4a0e-84a4-cd50a11ed17d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.248973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44681592-9986-4a0e-84a4-cd50a11ed17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.275344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-44681592-9986-4a0e-84a4-cd50a11ed17d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:28.276987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-44681592-9986-4a0e-84a4-cd50a11ed17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:28.318742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9733d-8edd-46aa-894e-5b07cdc9c9f1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.323723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.324415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.324705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.324994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.325700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.327693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.350013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 876/1764] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:28.358054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.358399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.358751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.378484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:28.380420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:28.388908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 877/1765] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:28.393240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.403359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c03944-9a4f-4930-ae26-2bcb285c2b02 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.408067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.408752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.409037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.409317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.410100 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:28.410485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.412394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.419603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 889/1766] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:28.430510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 878/1767] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:23:28.430673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.431561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.438733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:28.444952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8397e-1499-429b-92ea-c636cc374be0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.450585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.454726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.454726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.454726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.454726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.455859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41222f87-ae33-41ab-a679-742b420c5fce admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.455965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.462561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.463495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.463928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.464347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.465244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.467084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.479391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 890/1768] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:28.483312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.494202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86ee3-1ce4-4d25-bb69-4e80875d94d1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.502766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.506395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.506395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.506395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.506395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.507419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.521951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 891/1769] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:28.523012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.534948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f5456-d5a1-4ebc-805f-549ccac34d29 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.543435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 879/1770] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:28.544663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.550591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c8480-0653-42c9-91fa-0eabd3a57e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.552595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c8480-0653-42c9-91fa-0eabd3a57e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.552954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c8480-0653-42c9-91fa-0eabd3a57e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.553310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c8480-0653-42c9-91fa-0eabd3a57e94 admin admin] PATH_INFO: `/v3/projects/f91f86e458674558b7b62cdd9e945eae/users/14654ec95611472da8f89705599da7db/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.573102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c8480-0653-42c9-91fa-0eabd3a57e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91f86e458674558b7b62cdd9e945eae, user_id=14654ec95611472da8f89705599da7db, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.576941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c8480-0653-42c9-91fa-0eabd3a57e94 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.627049 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4f864-ac01-4b5d-bdc8-c38bb33f99bc admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.640983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.641985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.642276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.642562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.643352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.645704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.651246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 892/1771] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:28 2022] PUT /identity/v3/projects/f91f86e458674558b7b62cdd9e945eae/users/14654ec95611472da8f89705599da7db/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:28.658620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.659058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.659437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.673456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:28.679281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:28.683438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:28.735179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 880/1772] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:28.739900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.751093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 893/1773] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:28.751259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6117ffc-e4e5-410c-af47-361802ac161e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.756113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.756864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.757157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.758122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.758400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.760195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.760315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.761592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:28.780369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 881/1774] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:28.781298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.794948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f6a4d-f5aa-4a9b-8bbe-e2508b540c5b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.799981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.800692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.801007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.802398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.803215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.804851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.823393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 882/1775] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:28.824309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:28.837392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c60de3-2259-479b-9cc0-9a133a6551b3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.843072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.843903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.844296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.844572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] PATH_INFO: `/v3/projects/92096034892d4e888d6e73ad6c6ae2e0/users/b3a32638ed6044e5a93b7c36f3eaee46/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.854881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a548b1d-40d8-4ac1-a46f-e91144e60820 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:28.859304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30471c-c4a9-4569-8dd0-1057cc758c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:28.859968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30471c-c4a9-4569-8dd0-1057cc758c09 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.860260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30471c-c4a9-4569-8dd0-1057cc758c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.860542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30471c-c4a9-4569-8dd0-1057cc758c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:28.873371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30471c-c4a9-4569-8dd0-1057cc758c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.874314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92096034892d4e888d6e73ad6c6ae2e0, user_id=b3a32638ed6044e5a93b7c36f3eaee46, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:28.874893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30471c-c4a9-4569-8dd0-1057cc758c09 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.887232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:28.887795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 894/1776] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:28.963566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 883/1777] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:28 2022] PUT /identity/v3/projects/92096034892d4e888d6e73ad6c6ae2e0/users/b3a32638ed6044e5a93b7c36f3eaee46/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:28.974455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:28.974722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:28.975002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.001425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] MFA Rules not processed for user `b3a32638ed6044e5a93b7c36f3eaee46`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:29.002701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:29.075351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 895/1778] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:29.079893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:29.147836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d28d5-45f7-4361-ad47-156326b4c694 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:29.152990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:29.153655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.154024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.154326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.155038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:29.156959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:29.210075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:29.323154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 884/1779] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:29 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:29.327296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:29.338742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd1bb-76bc-441c-b0dc-98987b4cb121 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:29.396646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:29.397396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.397673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.397998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.398704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:29.400625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:29.511790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 896/1780] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:29 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:29.513057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:29.524520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95c9b-17d9-40b0-9235-3f7781fcfa96 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:29.535677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:29.535677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.535677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.535954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.536659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:29.538314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:29.554674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 885/1781] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:29.558319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:29.574247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac630966-2628-4cf0-af10-c2c3af4f41a3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:29.579146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:29.580054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.580348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.580625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] PATH_INFO: `/v3/projects/9830a4098d5940efa385f5d6383a65a3/users/633bd14df5f04de1b8bf4f413737edbc/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.593971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:29.620185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9830a4098d5940efa385f5d6383a65a3, user_id=633bd14df5f04de1b8bf4f413737edbc, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:29.623079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:29.726801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 897/1782] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:29 2022] PUT /identity/v3/projects/9830a4098d5940efa385f5d6383a65a3/users/633bd14df5f04de1b8bf4f413737edbc/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:29.733058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:29.748595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821da393-2c28-427b-a13b-f042df783b56 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:29.839487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286039f2-2c1e-4014-8965-ac691d5d0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:29.840238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286039f2-2c1e-4014-8965-ac691d5d0b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.840518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286039f2-2c1e-4014-8965-ac691d5d0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.840801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286039f2-2c1e-4014-8965-ac691d5d0b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.841594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286039f2-2c1e-4014-8965-ac691d5d0b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:29.843306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286039f2-2c1e-4014-8965-ac691d5d0b32 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:29.860508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:29.867465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 886/1783] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:29.875096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2692da-f144-4922-8148-807a353b8642 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:29.880949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:29.881910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.882193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.882468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] PATH_INFO: `/v3/projects/9830a4098d5940efa385f5d6383a65a3/users/633bd14df5f04de1b8bf4f413737edbc/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.885059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9830a4098d5940efa385f5d6383a65a3, user_id=633bd14df5f04de1b8bf4f413737edbc, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:29.888126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:29.901221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 898/1784] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:29 2022] PUT /identity/v3/projects/9830a4098d5940efa385f5d6383a65a3/users/633bd14df5f04de1b8bf4f413737edbc/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:29.918412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52cb5-3bda-42de-99a4-e5d38dfa2ee4 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:29.918791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52cb5-3bda-42de-99a4-e5d38dfa2ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:29.919046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba52cb5-3bda-42de-99a4-e5d38dfa2ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:29.959241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-cba52cb5-3bda-42de-99a4-e5d38dfa2ee4 None None] MFA Rules not processed for user `633bd14df5f04de1b8bf4f413737edbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:29.966467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cba52cb5-3bda-42de-99a4-e5d38dfa2ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:30.039542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:30.054569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 887/1785] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:30.072585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:30.074346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:30.218504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6edea-a8e7-4164-b5e7-c990d2b9c158 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:30.226265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:30.227286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:30.227585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:30.231364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:30.267909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:30.273043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:30.289327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 899/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:30.863155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:30.864313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:30.864313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:30.896532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] MFA Rules not processed for user `14654ec95611472da8f89705599da7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:30.897890 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:30.971475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 888/1787] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:30.982791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:30.992679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad56b3-34a9-4a7d-9633-02786578be0e service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:30.996702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:31.003106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:31.003106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:31.003106 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:31.005703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:31.008540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:31.010060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:31.019462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 900/1788] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:31.398028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:31.410076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94803f-2de0-47d2-80fc-4ffd17501aec None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:31.414928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633bd14df5f04de1b8bf4f413737edbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9830a4098d5940efa385f5d6383a65a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:31.415587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:31.415871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:31.416154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:31.416889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:31.417196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:31.418967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:31.432448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 889/1789] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:23:31.448019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:31.448602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c429ac9-3632-4e4b-9d25-2124dcfe7ae8 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:31.453245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633bd14df5f04de1b8bf4f413737edbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9830a4098d5940efa385f5d6383a65a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:31.453935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:31.454224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:31.454497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:31.455360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:31.457425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:31.553486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 901/1790] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:31 2022] POST /identity/v3/projects => generated 354 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:31.554702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:31.565219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07cb3d-c1d9-42d0-9d22-b291146a6626 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:31.630484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633bd14df5f04de1b8bf4f413737edbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9830a4098d5940efa385f5d6383a65a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:31.631661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:31.632205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:31.632613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:31.633636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:31.636595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:31.636595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:31.649075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 890/1791] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:23:31.697967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:31.710058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762f25-7857-4ba1-b1c2-81774ec3b354 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:31.717120 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '633bd14df5f04de1b8bf4f413737edbc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9830a4098d5940efa385f5d6383a65a3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:31.718213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:31.728360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:31.728360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] PATH_INFO: `/v3/projects/df84569aaf274c588da81b70c3a4ee18` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:31.728360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df84569aaf274c588da81b70c3a4ee18)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:31.728360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:31.851654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df84569aaf274c588da81b70c3a4ee18', 'request_id': 'req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:32.016707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df84569aaf274c588da81b70c3a4ee18', 'request_id': 'req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:32.023427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df84569aaf274c588da81b70c3a4ee18', 'request_id': 'req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:32.035983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] The token cache is being invalidate because project df84569aaf274c588da81b70c3a4ee18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:32.036296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:32.036959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a4eaa6a6-16e4-4ec6-b555-2c0cc1beb11f tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:32.038662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 902/1792] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:31 2022] DELETE /identity/v3/projects/df84569aaf274c588da81b70c3a4ee18 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:32.690806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:32.693461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:32.788069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330a502-d886-49c9-baab-658b8ee501b7 tempest-VolumeQuotaClassesTest-1481120350 tempest-VolumeQuotaClassesTest-1481120350-project-admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:32.796957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:32.858957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:32.860059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:32.860419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:32.860756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] PATH_INFO: `/v3/users/b3a32638ed6044e5a93b7c36f3eaee46` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:32.862153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a32638ed6044e5a93b7c36f3eaee46)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:32.864823 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:33.073272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a32638ed6044e5a93b7c36f3eaee46'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:33.096208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a32638ed6044e5a93b7c36f3eaee46'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:33.103749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a32638ed6044e5a93b7c36f3eaee46'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:33.104615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a32638ed6044e5a93b7c36f3eaee46'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:33.105234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a32638ed6044e5a93b7c36f3eaee46'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:33.216323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 891/1793] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:32 2022] DELETE /identity/v3/users/b3a32638ed6044e5a93b7c36f3eaee46 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:33.220791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa245-1cd5-4c93-b66f-17105be259e1 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:33.221389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa245-1cd5-4c93-b66f-17105be259e1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:33.221389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa245-1cd5-4c93-b66f-17105be259e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:33.240249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-27eaa245-1cd5-4c93-b66f-17105be259e1 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:33.241495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-27eaa245-1cd5-4c93-b66f-17105be259e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:33.313424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 903/1794] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:33.323821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:33.325686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:33.437141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f3692-ad9d-4600-beb5-736e3c1129af admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:33.442812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:33.443487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:33.443883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:33.445201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:33.457619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:33.459490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:33.472030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 892/1795] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:34.036866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:34.037157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:34.037607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:34.062208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] MFA Rules not processed for user `14654ec95611472da8f89705599da7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:34.063481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:34.216914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 904/1796] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:34.278236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:34.284343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:34.299637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484e7d-5795-48eb-b45f-d24ba812f1e8 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:34.305288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:34.306633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:34.309721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:34.309721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] PATH_INFO: `/v3/projects/92096034892d4e888d6e73ad6c6ae2e0` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:34.309721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92096034892d4e888d6e73ad6c6ae2e0)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:34.310887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:34.447515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:34.468558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92096034892d4e888d6e73ad6c6ae2e0', 'request_id': 'req-a64bd738-c254-4195-8dd1-599d68cdc642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:34.493250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92096034892d4e888d6e73ad6c6ae2e0', 'request_id': 'req-a64bd738-c254-4195-8dd1-599d68cdc642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:34.513520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92096034892d4e888d6e73ad6c6ae2e0', 'request_id': 'req-a64bd738-c254-4195-8dd1-599d68cdc642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:34.918011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] The token cache is being invalidate because project 92096034892d4e888d6e73ad6c6ae2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:35.052797 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.052797 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.052797 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 893/1797] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:34 2022] DELETE /identity/v3/projects/92096034892d4e888d6e73ad6c6ae2e0 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:35.056422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:35.062006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:35.091148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3599-5f95-4c3d-a855-ab83209f5dcc None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:35.120321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:35.121822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:35.188229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:35.189495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:35.189783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:35.190092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] PATH_INFO: `/v3/users/633bd14df5f04de1b8bf4f413737edbc` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:35.192431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=633bd14df5f04de1b8bf4f413737edbc)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:35.195438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:35.237235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd738-c254-4195-8dd1-599d68cdc642 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:35.246347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:35.247561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:35.247976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:35.248361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] PATH_INFO: `/v3/users/52bc9cfa43dd4221bae60c1c0fd797e2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:35.251108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bc9cfa43dd4221bae60c1c0fd797e2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:35.254252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:35.529659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '633bd14df5f04de1b8bf4f413737edbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.539621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bc9cfa43dd4221bae60c1c0fd797e2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.544926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '633bd14df5f04de1b8bf4f413737edbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.553527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bc9cfa43dd4221bae60c1c0fd797e2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.561775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bc9cfa43dd4221bae60c1c0fd797e2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.563800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bc9cfa43dd4221bae60c1c0fd797e2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.563800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bc9cfa43dd4221bae60c1c0fd797e2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.640532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '633bd14df5f04de1b8bf4f413737edbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.641272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '633bd14df5f04de1b8bf4f413737edbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.655015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6f39c0d0-00f0-47cb-b841-b42686fba1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '633bd14df5f04de1b8bf4f413737edbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:35.664403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 905/1798] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:35 2022] DELETE /identity/v3/users/633bd14df5f04de1b8bf4f413737edbc => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:35.765518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:35.765875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:35.766389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:35.773221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 894/1799] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:35 2022] DELETE /identity/v3/users/52bc9cfa43dd4221bae60c1c0fd797e2 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:35.788024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:35.789263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:35.864520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 906/1800] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:35.876506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:35.880879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:35.979230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:36.006352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8850a9-17f8-43d7-9b96-9ac1731d5dbc admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:36.040233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd521c8-7905-4656-b4b8-b3c9d1953809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:36.041462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd521c8-7905-4656-b4b8-b3c9d1953809 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.041758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd521c8-7905-4656-b4b8-b3c9d1953809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.042095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd521c8-7905-4656-b4b8-b3c9d1953809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.064152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd521c8-7905-4656-b4b8-b3c9d1953809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:36.068343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd521c8-7905-4656-b4b8-b3c9d1953809 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:36.093662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 895/1801] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:36.388532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:36.390071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:36.405744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3693b-30a4-45b1-ad20-e356ab8af555 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:36.413453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:36.415016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.415401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.415716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] PATH_INFO: `/v3/projects/9830a4098d5940efa385f5d6383a65a3` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.417397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9830a4098d5940efa385f5d6383a65a3)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:36.421058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:36.558399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9830a4098d5940efa385f5d6383a65a3', 'request_id': 'req-44d761c2-bec8-4ca9-ac83-666fa2f6f640'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:36.662292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9830a4098d5940efa385f5d6383a65a3', 'request_id': 'req-44d761c2-bec8-4ca9-ac83-666fa2f6f640'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:36.669489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9830a4098d5940efa385f5d6383a65a3', 'request_id': 'req-44d761c2-bec8-4ca9-ac83-666fa2f6f640'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:36.684436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] The token cache is being invalidate because project 9830a4098d5940efa385f5d6383a65a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:36.684795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:36.685878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:36.687557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 907/1802] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:36 2022] DELETE /identity/v3/projects/9830a4098d5940efa385f5d6383a65a3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:36.692714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830c505-7da5-4720-9ccb-bb404430c522 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.693569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830c505-7da5-4720-9ccb-bb404430c522 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.694086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830c505-7da5-4720-9ccb-bb404430c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.715609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a830c505-7da5-4720-9ccb-bb404430c522 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:36.717123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a830c505-7da5-4720-9ccb-bb404430c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:36.776103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:36.778010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:36.788215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 896/1803] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:36.795921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.796134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.796459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.821186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:36.825071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:36.830226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:36.837837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 897/1804] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:36.842087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:36.854770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff35103-fda4-409e-be31-c6cd516c5167 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:36.862786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:36.864068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.864517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.864726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.865484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:36.865795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:36.867451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:36.884665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 898/1805] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:23:36.884870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d761c2-bec8-4ca9-ac83-666fa2f6f640 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:36.886042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:36.888821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:36.889694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.890014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.891941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] PATH_INFO: `/v3/projects/3f8ed3fe115f40309671a54d1003bc76` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.891941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8ed3fe115f40309671a54d1003bc76)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:36.893376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:36.897013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21dcf6a-6037-426b-bb69-42072153be43 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:36.902224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:36.902839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:36.903125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:36.903470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:36.904164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:36.906103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.028145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 899/1806] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:36 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:37.032686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.044736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8ed3fe115f40309671a54d1003bc76', 'request_id': 'req-9b0e145b-62a4-4106-b09e-99c1779cff10'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:37.097367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb075e3-b01a-4627-8529-8b7470d6cf8e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.122539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8ed3fe115f40309671a54d1003bc76', 'request_id': 'req-9b0e145b-62a4-4106-b09e-99c1779cff10'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:37.128608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8ed3fe115f40309671a54d1003bc76', 'request_id': 'req-9b0e145b-62a4-4106-b09e-99c1779cff10'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:37.140807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] The token cache is being invalidate because project 3f8ed3fe115f40309671a54d1003bc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:37.142407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:37.142407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9b0e145b-62a4-4106-b09e-99c1779cff10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:37.146879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 908/1807] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:36 2022] DELETE /identity/v3/projects/3f8ed3fe115f40309671a54d1003bc76 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:37.148213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5e34-024a-4fdf-876c-c15e025b268a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.148510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5e34-024a-4fdf-876c-c15e025b268a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.148796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d5e34-024a-4fdf-876c-c15e025b268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.163834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.165476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.165476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.165476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.165950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.167756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.170170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c27d5e34-024a-4fdf-876c-c15e025b268a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:37.171386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c27d5e34-024a-4fdf-876c-c15e025b268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:37.181376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 909/1808] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:37.189231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.189522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.189890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.208013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:37.209235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:37.217487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 910/1809] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:37.223375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.232836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b62571-4dc5-40a2-b9fa-1f44666152a8 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.237544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.238875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.239369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.239658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.240565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:37.240878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.242604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.254848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 911/1810] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:23:37.259179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.268940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d45dfa-4d46-45de-96be-137b5206fb52 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.274133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.274840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.275131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.275417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.276151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.278563 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.307362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 900/1811] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/users => generated 305 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:37.313773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.315499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:37.328367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb51c6-8876-476e-9b49-58fb5441f060 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.333902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.334607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.339734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.339734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.339734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.339734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.348901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 901/1812] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:37.352738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.364626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc6ef-9627-43be-afb0-6b9ecc992f7b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.369884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.370706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.370819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.371079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.371912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.373943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.386436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 902/1813] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:37.390749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.401514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d29f-4b02-4c6f-9ed5-598c1c4ee24b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.407022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e78f3-dbe8-4a0d-9ad2-e4627722ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.408130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e78f3-dbe8-4a0d-9ad2-e4627722ac82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.408425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e78f3-dbe8-4a0d-9ad2-e4627722ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.408792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e78f3-dbe8-4a0d-9ad2-e4627722ac82 admin admin] PATH_INFO: `/v3/projects/beea0d0209c14d77aa1e41a1c344c63a/users/d9bfd2d341844269ae57ccb0f93db72c/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.424949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 912/1814] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:37.429634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.430672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e78f3-dbe8-4a0d-9ad2-e4627722ac82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beea0d0209c14d77aa1e41a1c344c63a, user_id=d9bfd2d341844269ae57ccb0f93db72c, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.433578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e78f3-dbe8-4a0d-9ad2-e4627722ac82 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.497909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d6ef-18fb-4e2d-93b6-2e6f3950ab6c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.504415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.505406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.505873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.506311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.507299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.509536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.528263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 903/1815] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:37 2022] PUT /identity/v3/projects/beea0d0209c14d77aa1e41a1c344c63a/users/d9bfd2d341844269ae57ccb0f93db72c/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:37.541149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.541449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.541735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.569224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] MFA Rules not processed for user `d9bfd2d341844269ae57ccb0f93db72c`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:37.570475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:37.651299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 913/1816] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/users => generated 303 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:37.655014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.662728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 904/1817] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:37.663609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.669979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f82e-db2a-4757-a9e7-1ce831465bd5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.747796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ebdb6-5c37-4443-9b39-24758f01aa7e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.753370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.755304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.756039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.756328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.756647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.757349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.759035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.763459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.764464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.765588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.766581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.772668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 914/1818] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:37.775406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.777509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.802090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed167c-ef61-4ef9-a95a-eff104ea9575 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.819983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.820864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.821591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.822121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.822962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.825578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.842805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 915/1819] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:37.845771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.859889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2c85a-ed7e-4468-bc39-5640e0cb8221 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:37.869692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c457b-7163-4783-9c3d-88eed9bbcc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:37.875001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c457b-7163-4783-9c3d-88eed9bbcc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:37.875001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c457b-7163-4783-9c3d-88eed9bbcc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:37.875001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c457b-7163-4783-9c3d-88eed9bbcc76 admin admin] PATH_INFO: `/v3/projects/7843cc940544400bb8b7fa44123d3168/users/c01caf71196445198189c3b1cdf92642/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:37.905853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 905/1820] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/projects => generated 409 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:37.909633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:37.912178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c457b-7163-4783-9c3d-88eed9bbcc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7843cc940544400bb8b7fa44123d3168, user_id=c01caf71196445198189c3b1cdf92642, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:37.915236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c457b-7163-4783-9c3d-88eed9bbcc76 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:37.925179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:38.003320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f646f0-d79a-4a36-81c4-d901e8b1545e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.008368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.009201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.009357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.009615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.010357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.012331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.070896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 916/1821] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:37 2022] PUT /identity/v3/projects/7843cc940544400bb8b7fa44123d3168/users/c01caf71196445198189c3b1cdf92642/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:38.098741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.098741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.098741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.136983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] MFA Rules not processed for user `c01caf71196445198189c3b1cdf92642`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:38.152570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 906/1822] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:37 2022] POST /identity/v3/users => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:38.152891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:38.156765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.177008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8244a1d-25fc-4792-89d9-8e403dbae19e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.225130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 917/1823] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:38.229441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.255675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.256972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.257359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.257737 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.259510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.261479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.278510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 907/1824] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:38.284274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.294245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876be9c4-58cf-4500-b5d5-27a931c8dde1 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.298830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.300036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.300036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.300244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] PATH_INFO: `/v3/projects/33063547f0da4ab3aa561dd6892b824f/users/93e8d42f1e5b4482b0efcd59688aeed5/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.306444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f85ae-2004-45e4-b48c-db814072be22 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.314890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.316021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.317202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.317323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.319083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.319213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33063547f0da4ab3aa561dd6892b824f, user_id=93e8d42f1e5b4482b0efcd59688aeed5, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.321837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.322202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.532970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 918/1825] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:38 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:38.537927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.539481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 908/1826] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:38 2022] PUT /identity/v3/projects/33063547f0da4ab3aa561dd6892b824f/users/93e8d42f1e5b4482b0efcd59688aeed5/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:38.540944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.604648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e62b-cc70-4c62-91b2-d1f3b0e78165 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.610060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.610770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.611056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.611333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.612027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.612345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cf5e3-aec3-49f3-993b-a90a6f2c7301 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.614326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.617984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.618814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.619208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.619579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.620410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.622170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.636552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 909/1827] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:38.640730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.652034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1065b-1e8c-4e3f-8f4a-02496a6f6d4f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.658186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c3079-fcfd-4a29-a6c0-2b848fa84580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.658186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3079-fcfd-4a29-a6c0-2b848fa84580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.658430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3079-fcfd-4a29-a6c0-2b848fa84580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.658768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c3079-fcfd-4a29-a6c0-2b848fa84580 admin admin] PATH_INFO: `/v3/projects/33063547f0da4ab3aa561dd6892b824f/users/93e8d42f1e5b4482b0efcd59688aeed5/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.661358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3079-fcfd-4a29-a6c0-2b848fa84580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33063547f0da4ab3aa561dd6892b824f, user_id=93e8d42f1e5b4482b0efcd59688aeed5, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.664884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c3079-fcfd-4a29-a6c0-2b848fa84580 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.675158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 910/1828] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:38 2022] PUT /identity/v3/projects/33063547f0da4ab3aa561dd6892b824f/users/93e8d42f1e5b4482b0efcd59688aeed5/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:38.685558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.685787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.686105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.701967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 919/1829] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:38 2022] POST /identity/v3/users => generated 309 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:38.709283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.724502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] MFA Rules not processed for user `93e8d42f1e5b4482b0efcd59688aeed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:38.724820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f670721-a4b8-4579-9e45-0e444d1bf1c2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.729013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:38.790507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.791394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.791675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.791959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.792707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.794689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.812225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 920/1830] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:38.813492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.824682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121750-b29e-42aa-9818-14e4b84fd825 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.830866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.832433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.832772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.833122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] PATH_INFO: `/v3/projects/febf1552a15a4d0283f7f162729d16f2/users/c3193914aeec4e7dba9a74248751a548/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.849878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 911/1831] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:38 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:38.850621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=febf1552a15a4d0283f7f162729d16f2, user_id=c3193914aeec4e7dba9a74248751a548, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.855382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.865310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.866759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:38.923794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082faee9-9237-4f89-ae02-e1208857bcc8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:38.927705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:38.928360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:38.928644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:38.928921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:38.946682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:38.946968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 921/1832] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:38 2022] PUT /identity/v3/projects/febf1552a15a4d0283f7f162729d16f2/users/c3193914aeec4e7dba9a74248751a548/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:38.947069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:38.947150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:38.948227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:38.955223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 912/1833] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:23:39.013126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91152374-9f8a-49cb-8a47-d391cd634b9c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:39.018087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5c1c9-2c33-4f48-a038-c9bd2e7dba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:39.018986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5c1c9-2c33-4f48-a038-c9bd2e7dba53 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:39.019274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5c1c9-2c33-4f48-a038-c9bd2e7dba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:39.020100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5c1c9-2c33-4f48-a038-c9bd2e7dba53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:39.020896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5c1c9-2c33-4f48-a038-c9bd2e7dba53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:39.022575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5c1c9-2c33-4f48-a038-c9bd2e7dba53 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:39.035004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 922/1834] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:39.039452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:39.054841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd4f3e-e80e-4ac4-b400-c447e2931188 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:39.062183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:39.063609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:39.064247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:39.064827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] PATH_INFO: `/v3/projects/febf1552a15a4d0283f7f162729d16f2/users/c3193914aeec4e7dba9a74248751a548/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:39.073944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=febf1552a15a4d0283f7f162729d16f2, user_id=c3193914aeec4e7dba9a74248751a548, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:39.078722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:39.099808 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 913/1835] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:39 2022] PUT /identity/v3/projects/febf1552a15a4d0283f7f162729d16f2/users/c3193914aeec4e7dba9a74248751a548/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:39.109973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:39.110341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:39.110602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:39.139640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] MFA Rules not processed for user `c3193914aeec4e7dba9a74248751a548`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:39.141004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:39.286905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 923/1836] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:39.398555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:39.416102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:39.512152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd229463-0503-41df-a905-cdfd591fd27a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:39.526449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:39.527032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:39.527432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:39.528365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:39.549933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:39.554649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:39.566030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 914/1837] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:39 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:39.623498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:39.623498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:39.639356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b420ea-ab91-46bb-aaa9-2d02b1c9ddd5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:39.643498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb73ea6-08aa-4201-8687-93461332fc4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:39.644235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73ea6-08aa-4201-8687-93461332fc4b service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:39.644781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73ea6-08aa-4201-8687-93461332fc4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:39.645128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb73ea6-08aa-4201-8687-93461332fc4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:39.710729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb73ea6-08aa-4201-8687-93461332fc4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:39.712320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb73ea6-08aa-4201-8687-93461332fc4b service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:39.734413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 924/1838] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:41.287965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:41.296292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:41.326420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:41.374228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbd457-3e05-4fad-b228-d61bf99e8d53 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:41.380290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:41.381123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:41.381411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:41.381685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] PATH_INFO: `/v3/users/c01caf71196445198189c3b1cdf92642` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:41.383002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01caf71196445198189c3b1cdf92642)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:41.385446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:41.469642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1578f48-47f2-4410-a4c5-2680cd47b47b None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:41.471286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1578f48-47f2-4410-a4c5-2680cd47b47b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:41.471474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1578f48-47f2-4410-a4c5-2680cd47b47b None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:41.473678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 925/1839] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:23:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:23:41.486537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:41.486843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:41.487212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:41.511104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:41.512477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:41.607948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01caf71196445198189c3b1cdf92642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:41.610948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 926/1840] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:23:41.634498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01caf71196445198189c3b1cdf92642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:41.644804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01caf71196445198189c3b1cdf92642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:41.650687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01caf71196445198189c3b1cdf92642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:41.650687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01caf71196445198189c3b1cdf92642'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:41.693676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:41.695209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:41.714303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc66f-3cf7-42ca-b6fa-0ea5aa693aee None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:41.720485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:41.721583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:41.721583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:41.721841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:41.724505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:41.739785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:41.741949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cad318-dfa6-421d-880a-407ee0eecaf2 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:41.759086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 927/1841] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:41.838412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 915/1842] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:41 2022] DELETE /identity/v3/users/c01caf71196445198189c3b1cdf92642 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:41.843155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:41.843452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:41.843780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:41.871295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:41.873329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:41.958865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 928/1843] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:41.968833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:41.970662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:42.065403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0048fc-3284-40a5-8e51-ee58b141e417 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:42.070246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:42.071107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:42.071721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:42.072037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:42.085988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:42.088397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:42.099973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 916/1844] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:23:42.628225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:42.805874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:43.652181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:43.653637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:43.673589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1967de67-875f-4d4c-8475-4940c2a89e54 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:43.689317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:43.689719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:43.690117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:43.690459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] PATH_INFO: `/v3/projects/7843cc940544400bb8b7fa44123d3168` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:43.692035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7843cc940544400bb8b7fa44123d3168)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:43.694002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:43.825715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7843cc940544400bb8b7fa44123d3168', 'request_id': 'req-946bdeaf-4c3f-4cae-9acd-c3674878750a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:43.832696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:43.889967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7843cc940544400bb8b7fa44123d3168', 'request_id': 'req-946bdeaf-4c3f-4cae-9acd-c3674878750a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:43.902305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7843cc940544400bb8b7fa44123d3168', 'request_id': 'req-946bdeaf-4c3f-4cae-9acd-c3674878750a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:43.919886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] The token cache is being invalidate because project 7843cc940544400bb8b7fa44123d3168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:43.920184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:43.920864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:43.922639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 929/1845] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:43 2022] DELETE /identity/v3/projects/7843cc940544400bb8b7fa44123d3168 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:43.927153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:43.937119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342d0c-94a7-4d35-ae5b-fe55351049cf service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:43.962674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:43.996482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:43.997493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:43.997884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:43.998268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] PATH_INFO: `/v3/users/c3193914aeec4e7dba9a74248751a548` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:43.999654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3193914aeec4e7dba9a74248751a548)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:44.001647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:44.218611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3193914aeec4e7dba9a74248751a548'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:44.231909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3193914aeec4e7dba9a74248751a548'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:44.239595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3193914aeec4e7dba9a74248751a548'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:44.240371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3193914aeec4e7dba9a74248751a548'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:44.240983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-736291d1-65f1-45ff-ac2f-468fa5490f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3193914aeec4e7dba9a74248751a548'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:44.312580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 917/1846] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:43 2022] DELETE /identity/v3/users/c3193914aeec4e7dba9a74248751a548 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:44.856706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:44.858962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:44.875183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:44.881520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bdeaf-4c3f-4cae-9acd-c3674878750a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:44.953359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:44.953359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:44.953359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:44.953359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] PATH_INFO: `/v3/projects/febf1552a15a4d0283f7f162729d16f2` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:44.953956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] RBAC: Authorizing `identity:delete_project(project_id=febf1552a15a4d0283f7f162729d16f2)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:44.955034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.086223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febf1552a15a4d0283f7f162729d16f2', 'request_id': 'req-4a504880-36e6-4b73-aabf-cc03def6130d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:45.158574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febf1552a15a4d0283f7f162729d16f2', 'request_id': 'req-4a504880-36e6-4b73-aabf-cc03def6130d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:45.166178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febf1552a15a4d0283f7f162729d16f2', 'request_id': 'req-4a504880-36e6-4b73-aabf-cc03def6130d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:45.179951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] The token cache is being invalidate because project febf1552a15a4d0283f7f162729d16f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:45.180241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:45.180901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a504880-36e6-4b73-aabf-cc03def6130d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:45.182466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 930/1847] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:44 2022] DELETE /identity/v3/projects/febf1552a15a4d0283f7f162729d16f2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:45.187320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.187781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.187870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.217828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:45.217828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:45.293223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 918/1848] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:45.301627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.301940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.302409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.322586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:45.323808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:45.333130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 931/1849] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:45.337226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.347353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57292528-6b73-4bc2-bcea-cf24630656d2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:45.352784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:45.353447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.353732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.354054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.354782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:45.355088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:45.356753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.369410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 919/1850] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:23:45.373840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.384199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69978d2-f20f-4bab-a7c9-22cfa0e4614a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:45.389123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:45.389790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.390108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.390386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.391088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:45.393011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.497240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 932/1851] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:45 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:45.501138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.513103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a20aa-01a9-4fcf-8c0c-b933b2b0b037 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:45.543932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:45.571650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:45.572354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.572642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.572915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.573645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:45.575671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.661474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 920/1852] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:45 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:45.665562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.676382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca3f51-6055-46c8-855b-ef401023ad24 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:45.680934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:45.681591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.681902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.682181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.682904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:45.684485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.694910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 933/1853] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:45.698874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.708887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf81cf1-e8db-4054-97c6-edbad76fa18c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:45.713461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b003a-2d4c-4677-90b0-59c8921b76fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:45.714102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b003a-2d4c-4677-90b0-59c8921b76fd admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.714389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b003a-2d4c-4677-90b0-59c8921b76fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.714670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b003a-2d4c-4677-90b0-59c8921b76fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.715394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b003a-2d4c-4677-90b0-59c8921b76fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:45.717131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b003a-2d4c-4677-90b0-59c8921b76fd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.728701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 921/1854] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:45.732641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.743276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e24f6e-f948-4f52-87c8-d635b1c306d0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:45.747940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:45.748790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.749075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.749352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] PATH_INFO: `/v3/projects/99dfabd9491646e1aefc839ba5eb0aa8/users/21ada72228e94ec3baf4242113db613b/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.764232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dfabd9491646e1aefc839ba5eb0aa8, user_id=21ada72228e94ec3baf4242113db613b, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:45.767006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:45.844660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 934/1855] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:45 2022] PUT /identity/v3/projects/99dfabd9491646e1aefc839ba5eb0aa8/users/21ada72228e94ec3baf4242113db613b/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:45.857908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:45.858204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:45.858488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:45.885444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] MFA Rules not processed for user `21ada72228e94ec3baf4242113db613b`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:45.886697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:45.954721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 922/1856] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:45.959871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:45.964711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:46.024070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6001-6088-4770-acf2-0e69bef84a28 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:46.029071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:46.029727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.030038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.030319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.031012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:46.032902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:46.126202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 935/1857] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:45 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:46.130825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:46.142162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887a009-eb39-4c7e-a033-7ab8f0202efc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:46.220855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:46.226358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.226358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.226358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.226358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:46.226358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:46.336606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 923/1858] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:46 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:46.338444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:46.356316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cce78-dab7-4dd0-864f-65ccb460f4ac admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:46.378093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:46.381607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.381607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.381607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.381923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:46.384257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:46.401196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 936/1859] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:46.405372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:46.417226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a4e4-0856-4651-bb3a-f0c2aa9c7ec4 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:46.423464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c7a11-53d2-4579-9284-c746dd87b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:46.424151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7a11-53d2-4579-9284-c746dd87b752 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.424480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7a11-53d2-4579-9284-c746dd87b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.424859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c7a11-53d2-4579-9284-c746dd87b752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.426070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7a11-53d2-4579-9284-c746dd87b752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:46.427716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c7a11-53d2-4579-9284-c746dd87b752 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:46.439883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 924/1860] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:46.448250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:46.464287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385df402-bbea-4c91-bfa4-b20a9a7d0cb3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:46.469332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:46.470265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.470549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.470828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] PATH_INFO: `/v3/projects/977a1a207e2949298dfa088ee3e7768d/users/06b9bb8f3bbb47bba194862d432961c6/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.488521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=977a1a207e2949298dfa088ee3e7768d, user_id=06b9bb8f3bbb47bba194862d432961c6, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:46.491481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:46.573145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 937/1861] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:46 2022] PUT /identity/v3/projects/977a1a207e2949298dfa088ee3e7768d/users/06b9bb8f3bbb47bba194862d432961c6/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:46.586941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.587787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.588787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.640538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] MFA Rules not processed for user `06b9bb8f3bbb47bba194862d432961c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:46.641579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:46.653035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:46.745060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 925/1862] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:46.749539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:46.828716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253fd4e-5418-40f2-ba67-839341a8dd50 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:46.834740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:46.835528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:46.835809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:46.836084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:46.836788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:46.838815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:46.964482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 938/1863] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:46 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:46.968529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:46.980567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba6aff-1b99-4160-9afc-2039699d0499 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:47.048831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:47.049652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.049976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.050778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.051488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:47.053430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:47.112545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 926/1864] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:46 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:47.122111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:47.132655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abd3b2-de06-4493-9bdc-80e43242652a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:47.137391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:47.138089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.138376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.138650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.139443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:47.141037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:47.152053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 939/1865] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:47.156233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:47.167151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed97d53-7a33-4b5b-9bb0-a0e66b610ba0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:47.171809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:47.172698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.172988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.173354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] PATH_INFO: `/v3/projects/85f8d6b09bcd46ae803859d9effbc622/users/c51019850877433c8d3447182c7d6629/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.189833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f8d6b09bcd46ae803859d9effbc622, user_id=c51019850877433c8d3447182c7d6629, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:47.193180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:47.285602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:47.286270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 927/1866] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:47 2022] PUT /identity/v3/projects/85f8d6b09bcd46ae803859d9effbc622/users/c51019850877433c8d3447182c7d6629/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:47.298593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c781213-4540-4794-b663-e04d4fe6c77d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:47.327526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:47.403570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21122142-b027-4de0-a621-8608fd49fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:47.404851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122142-b027-4de0-a621-8608fd49fc1f admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.405463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122142-b027-4de0-a621-8608fd49fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.405887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122142-b027-4de0-a621-8608fd49fc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.407634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122142-b027-4de0-a621-8608fd49fc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:47.409466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21122142-b027-4de0-a621-8608fd49fc1f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:47.431709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 940/1867] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:47.436265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:47.451124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d071a-b15b-4b4c-817f-82135d311ebb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:47.458337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:47.459486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.459851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.460230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] PATH_INFO: `/v3/projects/85f8d6b09bcd46ae803859d9effbc622/users/c51019850877433c8d3447182c7d6629/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.462921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f8d6b09bcd46ae803859d9effbc622, user_id=c51019850877433c8d3447182c7d6629, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:47.466891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:47.483275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 928/1868] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:47 2022] PUT /identity/v3/projects/85f8d6b09bcd46ae803859d9effbc622/users/c51019850877433c8d3447182c7d6629/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:47.494373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.495080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.496178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.578031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] MFA Rules not processed for user `c51019850877433c8d3447182c7d6629`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:47.579397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:47.662821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 941/1869] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:47.907462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:47.909188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:47.970653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63960f2c-a63c-4e2e-8cab-e208934c52d3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:47.974844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:47.975585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:47.975950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:47.976303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:47.986779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:47.989421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:47.999449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 929/1870] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:49.827072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:49.828846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:49.843663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b98d3-8cac-43f7-9080-8ca5704bc189 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:49.849398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b83cd-545c-4b6d-9beb-9393e2bef04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:49.849719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b83cd-545c-4b6d-9beb-9393e2bef04f service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:49.850157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b83cd-545c-4b6d-9beb-9393e2bef04f service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:49.850436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b83cd-545c-4b6d-9beb-9393e2bef04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:49.957773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b83cd-545c-4b6d-9beb-9393e2bef04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:49.959516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b83cd-545c-4b6d-9beb-9393e2bef04f service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:49.973949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 942/1871] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:54.033312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:54.035127 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:54.042339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:54.261454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5bfc98-5809-47e7-ad34-1e2cf43b768b service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:54.267190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:54.268337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:54.268695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:54.269724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] PATH_INFO: `/v3/users/d9bfd2d341844269ae57ccb0f93db72c` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:54.271579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bfd2d341844269ae57ccb0f93db72c)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:54.273658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:54.562616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bfd2d341844269ae57ccb0f93db72c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:54.579972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bfd2d341844269ae57ccb0f93db72c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:54.588597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bfd2d341844269ae57ccb0f93db72c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:54.589370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bfd2d341844269ae57ccb0f93db72c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:54.590546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bfd2d341844269ae57ccb0f93db72c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:54.769865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 930/1872] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:54 2022] DELETE /identity/v3/users/d9bfd2d341844269ae57ccb0f93db72c => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:54.774445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:54.774940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:54.775206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:54.803688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:54.804898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:54.860004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:54.883044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 943/1873] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:54.893343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:54.895668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:54.958016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d9731-f759-46a0-94fe-d0e47caec4cb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:54.962976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:54.964533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:54.969019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:54.969019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:54.976307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:54.977959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:55.001361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 931/1874] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:55.629429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:55.630901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:55.643262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223459e0-501d-4eac-8c26-baa0b07d9a12 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:55.650083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:55.651230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:55.651485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:55.652108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] PATH_INFO: `/v3/projects/beea0d0209c14d77aa1e41a1c344c63a` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:55.653628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beea0d0209c14d77aa1e41a1c344c63a)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:55.656043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:55.839117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beea0d0209c14d77aa1e41a1c344c63a', 'request_id': 'req-6befa1ad-bb50-4b5d-95ed-968d8c900e86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:55.959064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beea0d0209c14d77aa1e41a1c344c63a', 'request_id': 'req-6befa1ad-bb50-4b5d-95ed-968d8c900e86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:55.966521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beea0d0209c14d77aa1e41a1c344c63a', 'request_id': 'req-6befa1ad-bb50-4b5d-95ed-968d8c900e86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:55.980624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] The token cache is being invalidate because project beea0d0209c14d77aa1e41a1c344c63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:55.980913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:55.981790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:55.983605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 944/1875] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:55 2022] DELETE /identity/v3/projects/beea0d0209c14d77aa1e41a1c344c63a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:55.989613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:55.999861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1637f-2351-4e95-bed8-e5c692c128b9 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:56.026975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:56.067325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:56.068247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:56.068531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:56.068853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] PATH_INFO: `/v3/users/93e8d42f1e5b4482b0efcd59688aeed5` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:56.070211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e8d42f1e5b4482b0efcd59688aeed5)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:56.072347 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:56.289725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e8d42f1e5b4482b0efcd59688aeed5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:56.322990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e8d42f1e5b4482b0efcd59688aeed5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:56.333629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e8d42f1e5b4482b0efcd59688aeed5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:56.334513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e8d42f1e5b4482b0efcd59688aeed5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:56.335185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e8d42f1e5b4482b0efcd59688aeed5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:56.418853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 932/1876] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:55 2022] DELETE /identity/v3/users/93e8d42f1e5b4482b0efcd59688aeed5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:56.511859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:56.513294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:56.574512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befa1ad-bb50-4b5d-95ed-968d8c900e86 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:56.628179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:56.629287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:56.629573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:56.629875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:56.632141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:56.717004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:56.745955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:56.747586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:56.758250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 945/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:57.259223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:57.260683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:57.345706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deba83-419a-415e-9cb6-779ee768bdca admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:57.353022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:57.353944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:57.354279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:57.354561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] PATH_INFO: `/v3/users/445e674d62ac4ade995d216f9d7be7b4` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:57.355916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445e674d62ac4ade995d216f9d7be7b4)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:57.357903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:57.603123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445e674d62ac4ade995d216f9d7be7b4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.604699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:57.621631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445e674d62ac4ade995d216f9d7be7b4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.630784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445e674d62ac4ade995d216f9d7be7b4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.632515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445e674d62ac4ade995d216f9d7be7b4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.633353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e32690cb-02de-46ab-ae36-3dcdbefd5ce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445e674d62ac4ade995d216f9d7be7b4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.657232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:57.659819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:57.685029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfce837-b778-4103-a225-a9e322a018bf service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:57.700324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:57.701646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:57.702209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:57.702683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] PATH_INFO: `/v3/projects/33063547f0da4ab3aa561dd6892b824f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:57.704351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33063547f0da4ab3aa561dd6892b824f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:57.706649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:57.726170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 933/1878] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:57 2022] DELETE /identity/v3/users/445e674d62ac4ade995d216f9d7be7b4 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:57.730636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:57.730915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:57.731200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:57.754686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:57.755903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:57.828832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 934/1879] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:57.843659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:57.845134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:57.869037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33063547f0da4ab3aa561dd6892b824f', 'request_id': 'req-a82bc07b-0218-4759-b16d-b490973f3727'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.910791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ce8c6-5951-4d03-b7e2-452caee8b155 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:57.958552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33063547f0da4ab3aa561dd6892b824f', 'request_id': 'req-a82bc07b-0218-4759-b16d-b490973f3727'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.966175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33063547f0da4ab3aa561dd6892b824f', 'request_id': 'req-a82bc07b-0218-4759-b16d-b490973f3727'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.981635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] The token cache is being invalidate because project 33063547f0da4ab3aa561dd6892b824f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:57.981959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.982794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a82bc07b-0218-4759-b16d-b490973f3727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:57.987178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:57.988800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:57.989011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 946/1880] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:57 2022] DELETE /identity/v3/projects/33063547f0da4ab3aa561dd6892b824f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:57.990093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:57.990729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:57.991789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c112b2-145d-4231-bf9c-6a8556227515 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:57.992877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c112b2-145d-4231-bf9c-6a8556227515 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:57.993212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c112b2-145d-4231-bf9c-6a8556227515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:57.995926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:58.012878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-18c112b2-145d-4231-bf9c-6a8556227515 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:58.014304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-18c112b2-145d-4231-bf9c-6a8556227515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:58.078486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.080222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.086459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 947/1881] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:58.095203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.095501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.099357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.104417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 935/1882] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:23:58.116054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:58.117195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:58.129713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 948/1883] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:58.134036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.144133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150207a-b145-447a-bbde-fb6bf878664e service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.151107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.151107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.151107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.151394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.152517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:23:58.152674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.154305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.168479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 936/1884] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:23:58.177670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.187238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfad97d-a9ce-4267-aa61-0cd18c842074 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.193722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.194504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.194861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.195206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.196363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.198220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.307387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 949/1885] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:58 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:58.311607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.323697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea4a97-ca69-4903-ad65-f6be802d468f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.424124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.424942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.426349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.426470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.427377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.429960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.546037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 937/1886] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:58 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:58.554061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.571500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb9f9-1f93-48e9-a8d5-cf9a5b69e73a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.585969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.586673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.586961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.587421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.591601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.593552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.624972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 950/1887] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:58.629867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.647972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aed370-65a9-40cf-a65b-198142bf547a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.653666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a602d-926f-42fc-a63a-db953f4d7caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.655602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a602d-926f-42fc-a63a-db953f4d7caf admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.656505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a602d-926f-42fc-a63a-db953f4d7caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.656861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a602d-926f-42fc-a63a-db953f4d7caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.660965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a602d-926f-42fc-a63a-db953f4d7caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.663395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a602d-926f-42fc-a63a-db953f4d7caf admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.680038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 938/1888] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:58.684468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.696912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfaa59-7164-4fdf-97ae-4d65557806b4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.700685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:58.705160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.707776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.708468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.708919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] PATH_INFO: `/v3/projects/37c6831ffe1f49efabcb2c8dd5b30720/users/47da781ea9fe45a797d271392017bf4e/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.727271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c6831ffe1f49efabcb2c8dd5b30720, user_id=47da781ea9fe45a797d271392017bf4e, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.730801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:58.810885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:58.815837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 951/1889] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:58 2022] PUT /identity/v3/projects/37c6831ffe1f49efabcb2c8dd5b30720/users/47da781ea9fe45a797d271392017bf4e/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:58.827104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.827400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.827683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.845076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:58.846642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:58.878868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] MFA Rules not processed for user `47da781ea9fe45a797d271392017bf4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:58.881275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:58.936952 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd8368-57f1-4c27-b03d-cb22f1f3e67a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:58.943707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:58.945156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:58.947232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:58.947636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] PATH_INFO: `/v3/projects/f268dd7b62204654baa5c376e0c63cd1` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:58.949472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f268dd7b62204654baa5c376e0c63cd1)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:58.952565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.003559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 939/1890] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:59.007792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.025889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c712bf8-f020-4c7f-8a7c-dbf5bf0c4ea1 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:59.032017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:59.032691 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.033120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.033409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.037538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:59.039962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.107522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f268dd7b62204654baa5c376e0c63cd1', 'request_id': 'req-698b26c8-c6ce-4ed9-9413-714a4875d4a1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.164005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f268dd7b62204654baa5c376e0c63cd1', 'request_id': 'req-698b26c8-c6ce-4ed9-9413-714a4875d4a1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.172147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f268dd7b62204654baa5c376e0c63cd1', 'request_id': 'req-698b26c8-c6ce-4ed9-9413-714a4875d4a1'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.175998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 940/1891] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:59 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:23:59.177043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.187637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] The token cache is being invalidate because project f268dd7b62204654baa5c376e0c63cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:23:59.187997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.188605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.193863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 952/1892] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:23:58 2022] DELETE /identity/v3/projects/f268dd7b62204654baa5c376e0c63cd1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:59.195255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.196824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:59.302579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b26c8-c6ce-4ed9-9413-714a4875d4a1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:59.327972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465374-211f-460a-851b-dbeb8fccadcf admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:59.351812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:59.352638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.354282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.354766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.355741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:59.360158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.446384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:59.447876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.448167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.448453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] PATH_INFO: `/v3/users/51ec638239a543d99625439e4dc12a8e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.449775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ec638239a543d99625439e4dc12a8e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:59.451995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.473902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 941/1893] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:23:59 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:23:59.479340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.488752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:59.527758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7869-f210-4091-8224-232cae8ac6fb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:59.535285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:59.536083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.541717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.541717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.541717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:59.541717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.556849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 942/1894] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:23:59.558169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.571504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94525035-1aa5-4d41-a538-0ceb54aab4a7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:59.589469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:59.590238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.590536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.590809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.591561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:59.593263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.613572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 943/1895] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:23:59.614511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.627447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595478b-caaa-4d3f-a7c6-cd1db8eea306 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:23:59.634717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b01a8c-5687-4123-9739-c325ff77c465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:23:59.635805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01a8c-5687-4123-9739-c325ff77c465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.636084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01a8c-5687-4123-9739-c325ff77c465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.636452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01a8c-5687-4123-9739-c325ff77c465 admin admin] PATH_INFO: `/v3/projects/f1306d79203147b5ac237ef3fb22832c/users/843888a2718c435394b8043c6df867bf/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.648648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:59.684941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b01a8c-5687-4123-9739-c325ff77c465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1306d79203147b5ac237ef3fb22832c, user_id=843888a2718c435394b8043c6df867bf, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:23:59.687940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b01a8c-5687-4123-9739-c325ff77c465 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:23:59.736470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:23:59.741439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ec638239a543d99625439e4dc12a8e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.756991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ec638239a543d99625439e4dc12a8e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.810618 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 944/1896] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:23:59 2022] PUT /identity/v3/projects/f1306d79203147b5ac237ef3fb22832c/users/843888a2718c435394b8043c6df867bf/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:23:59.812769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:23:59.812769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:23:59.813019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:23:59.852650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] MFA Rules not processed for user `843888a2718c435394b8043c6df867bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:23:59.854476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:23:59.870462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ec638239a543d99625439e4dc12a8e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.871038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ec638239a543d99625439e4dc12a8e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.885467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ec638239a543d99625439e4dc12a8e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:23:59.894609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 953/1897] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:23:59 2022] DELETE /identity/v3/users/51ec638239a543d99625439e4dc12a8e => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:23:59.944030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 945/1898] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:23:59.945108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:23:59.946609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:00.030711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a4e02-5938-498b-a6af-2eb835fdd8e0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.037526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.038275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.038564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.038847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.039576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.041495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.165583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 954/1899] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:23:59 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:00.169594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.222352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:00.246966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe762c-894d-4607-8b63-d1a9f5c11227 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.318107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.318795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.319213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.319498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.320218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.322194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.413867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 946/1900] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:00 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:00.419469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.430603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f123-abd1-43b4-94e4-227fb643174d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.435171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.435828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.436110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.436379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.437132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.438740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.449692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 955/1901] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:00.453937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.464298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b5e1a-45e0-418a-bd76-b63fbc9d1a9c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.468970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.469877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.470163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.470440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] PATH_INFO: `/v3/projects/8868a647164745f2ba8806c20ec7f40d/users/04f9af1fbfb249958a435d1fa0d4bae8/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.485106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8868a647164745f2ba8806c20ec7f40d, user_id=04f9af1fbfb249958a435d1fa0d4bae8, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.488733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.492832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.495743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:00.527257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7e72-1ba8-4f10-9144-f69c0189696e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.532382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.533323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.533607 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.533923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] PATH_INFO: `/v3/projects/9339a2d9b61145b6b8d111c72c43d8d3` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.535664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9339a2d9b61145b6b8d111c72c43d8d3)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.537619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.579021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 947/1902] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:00 2022] PUT /identity/v3/projects/8868a647164745f2ba8806c20ec7f40d/users/04f9af1fbfb249958a435d1fa0d4bae8/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:00.583546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.633973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:00.651925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9339a2d9b61145b6b8d111c72c43d8d3', 'request_id': 'req-36853e41-10c7-4fe5-9873-7e6f3eeae28b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:00.664978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede0f9-42dd-4c74-897a-4ec45b9d2d2f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.725030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.725693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.726008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.726286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.727009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.728612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.742219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 948/1903] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:00.745964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.757177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0094f-8c98-4f93-868e-5e9b3804ff39 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.760539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6010ba-f5ba-439d-99c4-0cd8582a3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.761423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6010ba-f5ba-439d-99c4-0cd8582a3748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.761704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6010ba-f5ba-439d-99c4-0cd8582a3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.762013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6010ba-f5ba-439d-99c4-0cd8582a3748 admin admin] PATH_INFO: `/v3/projects/8868a647164745f2ba8806c20ec7f40d/users/04f9af1fbfb249958a435d1fa0d4bae8/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.763994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6010ba-f5ba-439d-99c4-0cd8582a3748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8868a647164745f2ba8806c20ec7f40d, user_id=04f9af1fbfb249958a435d1fa0d4bae8, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.766712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6010ba-f5ba-439d-99c4-0cd8582a3748 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:00.777238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 949/1904] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:00 2022] PUT /identity/v3/projects/8868a647164745f2ba8806c20ec7f40d/users/04f9af1fbfb249958a435d1fa0d4bae8/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:00.785428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9339a2d9b61145b6b8d111c72c43d8d3', 'request_id': 'req-36853e41-10c7-4fe5-9873-7e6f3eeae28b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:00.788185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f7a66-7311-4bf7-8ecf-4c192f430867 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.788571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f7a66-7311-4bf7-8ecf-4c192f430867 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.788927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f7a66-7311-4bf7-8ecf-4c192f430867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.793608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9339a2d9b61145b6b8d111c72c43d8d3', 'request_id': 'req-36853e41-10c7-4fe5-9873-7e6f3eeae28b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:00.807141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] The token cache is being invalidate because project 9339a2d9b61145b6b8d111c72c43d8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:00.807434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:00.808156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-36853e41-10c7-4fe5-9873-7e6f3eeae28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:00.809769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 956/1905] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:00 2022] DELETE /identity/v3/projects/9339a2d9b61145b6b8d111c72c43d8d3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:00.819796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.820086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.820407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.824868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-228f7a66-7311-4bf7-8ecf-4c192f430867 None None] MFA Rules not processed for user `04f9af1fbfb249958a435d1fa0d4bae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:00.826128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-228f7a66-7311-4bf7-8ecf-4c192f430867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:00.839947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:00.841164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:00.911862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 950/1906] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:00.923734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 957/1907] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:00.931246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.931612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.932029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.942745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:00.950918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.952535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:00.958758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:00.959968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:00.969838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 951/1908] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:00.972702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:00.982358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd7650-c033-40e6-9f2a-8339b88198e0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:00.987146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:00.988529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:00.988934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:00.989212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:00.992369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:00.992369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:00.992369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.009970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 952/1909] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:24:01.012401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.013299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d767500-3432-4be2-98c7-be0af95906dd None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.019016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.020133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.020553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.020947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.022240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01906000-53c0-4036-aa00-452452fcb3e6 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.027225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.027874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.028162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.028442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.029159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.031201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.031558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.033045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.043868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 958/1910] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:01.135514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 953/1911] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:01 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:01.136618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.147593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb09b8-5858-4395-84cd-b28e156ced3c service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.204905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.205505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.205787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.206321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.207111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.209023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.295635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 959/1912] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:01 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:01.299630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.311244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189deac-f5c0-4e78-a2a2-bd90f52371e8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.316484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.317132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.317416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.317692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.318448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.320050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.329959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 954/1913] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:01.334291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.344756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d425cc9-9361-460a-b70c-b0a0c3c1fa74 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.350181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.350981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.351370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.351659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.352397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.354040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.365108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 960/1914] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:01.369365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.379973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059095c-a96a-4406-be6b-b961c0a5be7f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.384659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea2a98-3c94-4f7e-ad4d-4fdcbf74c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.385550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea2a98-3c94-4f7e-ad4d-4fdcbf74c679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.385849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea2a98-3c94-4f7e-ad4d-4fdcbf74c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.386131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea2a98-3c94-4f7e-ad4d-4fdcbf74c679 admin admin] PATH_INFO: `/v3/projects/f53a5dacd32e4be8aa147a466694f52a/users/d4effde578404859b857afcf408db792/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.402052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea2a98-3c94-4f7e-ad4d-4fdcbf74c679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53a5dacd32e4be8aa147a466694f52a, user_id=d4effde578404859b857afcf408db792, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.404943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea2a98-3c94-4f7e-ad4d-4fdcbf74c679 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.513118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 955/1915] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:01 2022] PUT /identity/v3/projects/f53a5dacd32e4be8aa147a466694f52a/users/d4effde578404859b857afcf408db792/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:01.517326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.524561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.524875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.525156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.556760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] MFA Rules not processed for user `d4effde578404859b857afcf408db792`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:01.558450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:01.586554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56e6c-5517-428a-9e39-04cb05e946c2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.621667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:01.648001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.649020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.649311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.649592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.651515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:01.655526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 956/1916] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:01.660211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.662112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:01.683839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:01.718602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.720061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.729688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 961/1917] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:01.730520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.731517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de90fe-894a-47d9-bab3-213e1c9c1011 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.736673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.737830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.738192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.738610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] PATH_INFO: `/v3/users/21ada72228e94ec3baf4242113db613b` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.740026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ada72228e94ec3baf4242113db613b)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.742147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.742545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7757b4-f44b-4ea0-b66d-1de8bdb5745f service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:01.750402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:01.751219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:01.751601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:01.752037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:01.752914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:01.754899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:01.891137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 962/1918] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:01 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:01.894233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:01.952652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ada72228e94ec3baf4242113db613b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:01.971054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ada72228e94ec3baf4242113db613b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:01.980245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ada72228e94ec3baf4242113db613b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:01.981006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ada72228e94ec3baf4242113db613b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:01.981645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-52c09b5e-4a3f-4dc8-bf0b-2dbd7c0378e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ada72228e94ec3baf4242113db613b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:01.996427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e92768-9960-44f8-a655-de2f15b31a0c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.001377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.002098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.002387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.002668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.003931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.007918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.058341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 957/1919] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:01 2022] DELETE /identity/v3/users/21ada72228e94ec3baf4242113db613b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:02.059874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.060171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.060457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.084278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:02.085489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:02.102213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 963/1920] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:01 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:02.105611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.107404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:02.120127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:02.131364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62881ee-de5e-4d17-b2c1-c1893612d377 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.155459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:02.177572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 958/1921] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:02.189424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.194311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:02.233625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.234645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.235011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.235348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.236273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.238910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.249881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 964/1922] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:02.255090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.266319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc2fab-a8be-4e80-a67b-81c016faa20c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.267460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d4989-ab63-4841-bbfa-e7cefacd6ba5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.273637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.273778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.273915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.273915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.273915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] PATH_INFO: `/v3/projects/9f623171c8f24807a3a03ac445a57df9/users/ab8a3cbad69d42d7980362e6efec0460/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.274182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.274182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.274182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.286580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.288083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.290540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f623171c8f24807a3a03ac445a57df9, user_id=ab8a3cbad69d42d7980362e6efec0460, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.293398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.299166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 959/1923] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:02.436736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 965/1924] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:02 2022] PUT /identity/v3/projects/9f623171c8f24807a3a03ac445a57df9/users/ab8a3cbad69d42d7980362e6efec0460/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:02.441191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.451605 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf35d6f-2a58-436f-b613-13dbb2a26b51 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.519661 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f354bf-6088-4dfa-beab-9ad417051eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.520358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f354bf-6088-4dfa-beab-9ad417051eed admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.520735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f354bf-6088-4dfa-beab-9ad417051eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.520998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f354bf-6088-4dfa-beab-9ad417051eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.521735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f354bf-6088-4dfa-beab-9ad417051eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.523380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f354bf-6088-4dfa-beab-9ad417051eed admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.534245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 960/1925] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:02.539069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.549901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a964892-c29b-4ff5-a9d7-cd864960e112 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.555518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.556443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.556722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.556998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] PATH_INFO: `/v3/projects/9f623171c8f24807a3a03ac445a57df9/users/ab8a3cbad69d42d7980362e6efec0460/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.559079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f623171c8f24807a3a03ac445a57df9, user_id=ab8a3cbad69d42d7980362e6efec0460, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.561911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.573020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 966/1926] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:02 2022] PUT /identity/v3/projects/9f623171c8f24807a3a03ac445a57df9/users/ab8a3cbad69d42d7980362e6efec0460/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:02.583749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.584048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.584333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.621118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] MFA Rules not processed for user `ab8a3cbad69d42d7980362e6efec0460`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:02.622501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:02.692414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 961/1927] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:02.703925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.705885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:02.731388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:02.733229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:02.796369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54242d6a-a90b-4349-a1cf-ca6e52b8ea8e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.801701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.802552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.802996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.803455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.814315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.815764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:02.818401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.829922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 967/1928] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:02.833558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7b7ef-1a20-4cdc-8686-b335ede8794f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:02.839345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:02.840382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:02.840522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:02.840821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] PATH_INFO: `/v3/projects/99dfabd9491646e1aefc839ba5eb0aa8` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:02.842050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dfabd9491646e1aefc839ba5eb0aa8)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:02.848141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:02.987408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dfabd9491646e1aefc839ba5eb0aa8', 'request_id': 'req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:02.994305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dfabd9491646e1aefc839ba5eb0aa8', 'request_id': 'req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.000509 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dfabd9491646e1aefc839ba5eb0aa8', 'request_id': 'req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.043473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:03.052484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cf316-026f-4323-a95f-421c5f45ce14 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:03.064903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:03.105416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:03.106145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.106427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.106700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.108584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:03.132609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] The token cache is being invalidate because project 99dfabd9491646e1aefc839ba5eb0aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:03.133021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.133750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.137009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 962/1929] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:02 2022] DELETE /identity/v3/projects/99dfabd9491646e1aefc839ba5eb0aa8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:03.142329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:03.144288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:03.171773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:03.173228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:03.182725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 968/1930] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:03.210452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a9708-b8a7-43f3-a199-1f8fdc3d9e44 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:03.215263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:03.216138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:03.216545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:03.216832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] PATH_INFO: `/v3/users/06b9bb8f3bbb47bba194862d432961c6` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:03.218081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b9bb8f3bbb47bba194862d432961c6)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:03.220012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:03.466811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b9bb8f3bbb47bba194862d432961c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.471977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:03.478945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b9bb8f3bbb47bba194862d432961c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.485728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b9bb8f3bbb47bba194862d432961c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.486490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b9bb8f3bbb47bba194862d432961c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.487751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b9bb8f3bbb47bba194862d432961c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:03.558564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 963/1931] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:03 2022] DELETE /identity/v3/users/06b9bb8f3bbb47bba194862d432961c6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:03.994099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.007117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6250e-80dc-4284-bc01-1bc49e87c2ba service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.084670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.085569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.085916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.086201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] PATH_INFO: `/v3/projects/977a1a207e2949298dfa088ee3e7768d` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.087410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=977a1a207e2949298dfa088ee3e7768d)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.089538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.229372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977a1a207e2949298dfa088ee3e7768d', 'request_id': 'req-7afb1d58-583c-4fda-be66-6860a7110d7e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.357981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977a1a207e2949298dfa088ee3e7768d', 'request_id': 'req-7afb1d58-583c-4fda-be66-6860a7110d7e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.373321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977a1a207e2949298dfa088ee3e7768d', 'request_id': 'req-7afb1d58-583c-4fda-be66-6860a7110d7e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.382513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:04.387098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] The token cache is being invalidate because project 977a1a207e2949298dfa088ee3e7768d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:04.392552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.392552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.392552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 969/1932] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:03 2022] DELETE /identity/v3/projects/977a1a207e2949298dfa088ee3e7768d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:04.395723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:04.397225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:04.410531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f28b8-f233-4b26-bb4b-5080fa90bc31 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:04.473038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:04.474212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:04.474508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:04.474839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] PATH_INFO: `/v3/users/c51019850877433c8d3447182c7d6629` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:04.476061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51019850877433c8d3447182c7d6629)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:04.478045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:04.743844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51019850877433c8d3447182c7d6629'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.758612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51019850877433c8d3447182c7d6629'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.764495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51019850877433c8d3447182c7d6629'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.765014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51019850877433c8d3447182c7d6629'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.765641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4ab44a2b-6246-4cec-bca9-57635090f8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51019850877433c8d3447182c7d6629'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:04.911814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 964/1933] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:04 2022] DELETE /identity/v3/users/c51019850877433c8d3447182c7d6629 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:05.450917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:05.452628 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:05.467381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb1d58-583c-4fda-be66-6860a7110d7e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:05.547578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:05.548475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:05.548780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:05.549248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] PATH_INFO: `/v3/projects/85f8d6b09bcd46ae803859d9effbc622` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:05.550408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f8d6b09bcd46ae803859d9effbc622)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:05.553225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:05.730911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f8d6b09bcd46ae803859d9effbc622', 'request_id': 'req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.838315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f8d6b09bcd46ae803859d9effbc622', 'request_id': 'req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.845706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f8d6b09bcd46ae803859d9effbc622', 'request_id': 'req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.870246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] The token cache is being invalidate because project 85f8d6b09bcd46ae803859d9effbc622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:05.870550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.872134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-aa917ec2-df0a-4eac-b8bf-2f6a2641615f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:05.877846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 970/1934] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:05 2022] DELETE /identity/v3/projects/85f8d6b09bcd46ae803859d9effbc622 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:05.880621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:05.882632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:05.882632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:05.900003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:05.901220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:05.952144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:05.966988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 965/1935] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:05.975902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:05.976200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:05.976490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:05.997476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:05.998901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:06.008805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 971/1936] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:06.012468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.023474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb10ea-ac6d-4d67-87d4-81f5f1583443 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.028648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.029325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.029612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.029936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.030676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:06.030995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.032619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.049167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 966/1937] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:06.050587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.063230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9730e-e762-4a5b-b3f6-b19f71dec79a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.082989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.083900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.084188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.084467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.085203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.087253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.262438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 972/1938] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:06 2022] POST /identity/v3/projects => generated 401 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:06.263294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.274723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea656db2-6f45-4a3e-89cd-afe4452c11ba admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.337241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.337955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.338263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.338526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.339301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.341230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.469489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.471238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:06.483959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120148-aaae-43fe-ac71-3de58f295491 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.490317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.491230 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.491581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.491881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] PATH_INFO: `/v3/users/47da781ea9fe45a797d271392017bf4e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.493405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=47da781ea9fe45a797d271392017bf4e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.495889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.518487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 967/1939] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:06 2022] POST /identity/v3/users => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:06.521454 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.532564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818a5c0-9c29-4826-b5a6-ac7967773a27 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.549283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.549283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.549283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.549283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.549777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.549777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.551097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 968/1940] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:06.555931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.566368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237e52-a2c4-4b26-8622-b7fb184713eb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.571979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.572654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.572943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.573227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.574028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.584204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.585673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 969/1941] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:06.589911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:06.600460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a90b0-819f-4688-a993-0bebd41c0567 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:06.605129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ad1b9-26b8-4e94-ade6-280ba9092d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:06.606040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad1b9-26b8-4e94-ade6-280ba9092d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.606330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad1b9-26b8-4e94-ade6-280ba9092d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.606633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ad1b9-26b8-4e94-ade6-280ba9092d92 admin admin] PATH_INFO: `/v3/projects/d092764caf504b18806bc2515c010937/users/9aeaa959f0d94fd6a95acf9b331571ce/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.621964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad1b9-26b8-4e94-ade6-280ba9092d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d092764caf504b18806bc2515c010937, user_id=9aeaa959f0d94fd6a95acf9b331571ce, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:06.624663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ad1b9-26b8-4e94-ade6-280ba9092d92 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:06.813197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 970/1942] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:06 2022] PUT /identity/v3/projects/d092764caf504b18806bc2515c010937/users/9aeaa959f0d94fd6a95acf9b331571ce/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:06.817997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:06.818312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:06.818775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:06.868364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] MFA Rules not processed for user `9aeaa959f0d94fd6a95acf9b331571ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:06.869587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:06.951626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47da781ea9fe45a797d271392017bf4e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.962808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:06.974170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47da781ea9fe45a797d271392017bf4e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:06.974369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 971/1943] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:06.975700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.047434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d026eb-4cbd-4680-b9cc-daf712af48ac None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.052899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.053409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.053702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.054013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.058179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.060151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.075155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47da781ea9fe45a797d271392017bf4e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:07.080772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47da781ea9fe45a797d271392017bf4e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:07.088774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e1a5472c-313b-4afb-8112-0c9208d5f5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47da781ea9fe45a797d271392017bf4e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:07.094888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 973/1944] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:06 2022] DELETE /identity/v3/users/47da781ea9fe45a797d271392017bf4e => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:07.099127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.099423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.099709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.117180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:07.118414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:07.167291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 972/1945] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:06 2022] POST /identity/v3/projects => generated 401 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:07.171812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.173512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:07.179579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 974/1946] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:07.194564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.194564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:07.237723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84320e72-56d0-4486-af3d-c728411b10c9 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.243647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.246513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.246513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.246513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.246513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.247544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.252553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad452c4f-8226-4e46-9a3f-69e61340fdfd None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.308940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.309597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.309904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.310268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.320694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.322670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.332924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 975/1947] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:07.362039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 973/1948] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:07 2022] POST /identity/v3/users => generated 307 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:07.367655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.379204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559982d-fc18-403d-8557-90e43ad32d61 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.385617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.386296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.386595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.386879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.387717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.390495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.409847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 976/1949] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:07.412324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.424573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd06f1-ef6f-4677-9e5c-d9aa4244e548 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.431030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.432090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.432478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.432856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] PATH_INFO: `/v3/projects/b85f7a5fbe2949cb9dabbfcc9a91145a/users/04b16a1bf24c4d91aacd0eb6bfa981b5/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.452718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85f7a5fbe2949cb9dabbfcc9a91145a, user_id=04b16a1bf24c4d91aacd0eb6bfa981b5, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.455497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.555302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 974/1950] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:07 2022] PUT /identity/v3/projects/b85f7a5fbe2949cb9dabbfcc9a91145a/users/04b16a1bf24c4d91aacd0eb6bfa981b5/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:07.559511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.570490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3736-64f9-4c9f-a440-25faccf75c7a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.656761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6f389-f3f5-4543-b5bf-189eddb54e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.658836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6f389-f3f5-4543-b5bf-189eddb54e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.658836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6f389-f3f5-4543-b5bf-189eddb54e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.659203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6f389-f3f5-4543-b5bf-189eddb54e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.660166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6f389-f3f5-4543-b5bf-189eddb54e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.662944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6f389-f3f5-4543-b5bf-189eddb54e7c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.679083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 977/1951] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:07.683356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.694869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4463-c7de-413a-982f-729d9958990f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.701927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.702830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.703187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.703445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] PATH_INFO: `/v3/projects/b85f7a5fbe2949cb9dabbfcc9a91145a/users/04b16a1bf24c4d91aacd0eb6bfa981b5/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.705403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85f7a5fbe2949cb9dabbfcc9a91145a, user_id=04b16a1bf24c4d91aacd0eb6bfa981b5, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.708697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.719518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 975/1952] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:07 2022] PUT /identity/v3/projects/b85f7a5fbe2949cb9dabbfcc9a91145a/users/04b16a1bf24c4d91aacd0eb6bfa981b5/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:07.730970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.731258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.731557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.761534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] MFA Rules not processed for user `04b16a1bf24c4d91aacd0eb6bfa981b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:07.762820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:07.768236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:07.831764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.833626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:07.849236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 978/1953] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:07.864307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:07.866254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:07.933730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a77f2-d002-4443-9157-914f694eff95 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.939569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.942864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.942864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.942864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] PATH_INFO: `/v3/projects/37c6831ffe1f49efabcb2c8dd5b30720` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.943121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c6831ffe1f49efabcb2c8dd5b30720)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.945588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.950569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffa5be-7f66-4e89-8f0a-79cbef4572d5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:07.956354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb845a-e356-4bef-ab21-507248dbe12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:07.957392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb845a-e356-4bef-ab21-507248dbe12e service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:07.957817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb845a-e356-4bef-ab21-507248dbe12e service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:07.958427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb845a-e356-4bef-ab21-507248dbe12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:07.969246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb845a-e356-4bef-ab21-507248dbe12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:07.971306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb845a-e356-4bef-ab21-507248dbe12e service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:07.983296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 979/1954] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:08.004301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:08.004301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:08.004301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:08.023684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] MFA Rules not processed for user `14654ec95611472da8f89705599da7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:08.027825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:08.090430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c6831ffe1f49efabcb2c8dd5b30720', 'request_id': 'req-385eeca9-1871-465e-b085-b11a9b8eeb7f'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.097755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c6831ffe1f49efabcb2c8dd5b30720', 'request_id': 'req-385eeca9-1871-465e-b085-b11a9b8eeb7f'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.105269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c6831ffe1f49efabcb2c8dd5b30720', 'request_id': 'req-385eeca9-1871-465e-b085-b11a9b8eeb7f'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.115261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 980/1955] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:08.199113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] The token cache is being invalidate because project 37c6831ffe1f49efabcb2c8dd5b30720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:08.201090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.202014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.204720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 976/1956] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:07 2022] DELETE /identity/v3/projects/37c6831ffe1f49efabcb2c8dd5b30720 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:08.209172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:08.226558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:08.227400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4b1cc-4cf7-48b5-b24a-fe2849824e24 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:08.228157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:08.308190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eeca9-1871-465e-b085-b11a9b8eeb7f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:08.312146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:08.312807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:08.313104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:08.313388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:08.315323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:08.326285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:08.327170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:08.327543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:08.328009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] PATH_INFO: `/v3/users/843888a2718c435394b8043c6df867bf` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:08.329272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843888a2718c435394b8043c6df867bf)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:08.331246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:08.386675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:08.388078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:08.398341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 977/1957] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:08.497307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:08.628364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843888a2718c435394b8043c6df867bf'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.641126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843888a2718c435394b8043c6df867bf'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.698384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843888a2718c435394b8043c6df867bf'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.699063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843888a2718c435394b8043c6df867bf'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.706703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843888a2718c435394b8043c6df867bf'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:08.712912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 981/1958] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:08 2022] DELETE /identity/v3/users/843888a2718c435394b8043c6df867bf => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:08.751930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:09.237245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:09.239453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:09.257581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176b23b-d3f0-4ea4-b434-82a3d99ea54b service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:09.350718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:09.351593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:09.351885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:09.352166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] PATH_INFO: `/v3/projects/f1306d79203147b5ac237ef3fb22832c` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:09.353371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1306d79203147b5ac237ef3fb22832c)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:09.355350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:09.482666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:09.500974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1306d79203147b5ac237ef3fb22832c', 'request_id': 'req-f7b89d0c-4fce-41d8-960e-d1dc64535582'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:09.507923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1306d79203147b5ac237ef3fb22832c', 'request_id': 'req-f7b89d0c-4fce-41d8-960e-d1dc64535582'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:09.513314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1306d79203147b5ac237ef3fb22832c', 'request_id': 'req-f7b89d0c-4fce-41d8-960e-d1dc64535582'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:09.607047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] The token cache is being invalidate because project f1306d79203147b5ac237ef3fb22832c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:09.607342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:09.608013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:09.609610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 978/1959] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:09 2022] DELETE /identity/v3/projects/f1306d79203147b5ac237ef3fb22832c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:09.613601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:09.615794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:09.628399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be1e37-38cb-412f-ab37-ad662a8d4b43 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:09.632151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:09.691098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:09.693292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:09.693576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:09.694005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] PATH_INFO: `/v3/users/04f9af1fbfb249958a435d1fa0d4bae8` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:09.696023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f9af1fbfb249958a435d1fa0d4bae8)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:09.697976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:09.970826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f9af1fbfb249958a435d1fa0d4bae8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:09.983571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f9af1fbfb249958a435d1fa0d4bae8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.071692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f9af1fbfb249958a435d1fa0d4bae8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.072310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f9af1fbfb249958a435d1fa0d4bae8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.080212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-409f4c03-5bf9-4d37-9c1d-7ca84386e0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f9af1fbfb249958a435d1fa0d4bae8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.086526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 982/1960] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:09 2022] DELETE /identity/v3/users/04f9af1fbfb249958a435d1fa0d4bae8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:10.287908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:10.525034 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:10.526504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:10.542228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b89d0c-4fce-41d8-960e-d1dc64535582 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:10.607320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:10.608199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:10.608484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:10.608766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] PATH_INFO: `/v3/projects/8868a647164745f2ba8806c20ec7f40d` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:10.610001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8868a647164745f2ba8806c20ec7f40d)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:10.611936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:10.757941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8868a647164745f2ba8806c20ec7f40d', 'request_id': 'req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.764005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8868a647164745f2ba8806c20ec7f40d', 'request_id': 'req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.769549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8868a647164745f2ba8806c20ec7f40d', 'request_id': 'req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.859571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] The token cache is being invalidate because project 8868a647164745f2ba8806c20ec7f40d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:10.859884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.860483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4fcbcaa2-f4b3-4c95-80a7-88452d55b725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:10.862115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 979/1961] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:10 2022] DELETE /identity/v3/projects/8868a647164745f2ba8806c20ec7f40d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:10.868150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:10.868621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:10.868735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:10.888399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:10.889636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:10.951664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 983/1962] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:10.960677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:10.960998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:10.961298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:10.980750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:10.981457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:10.990015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 980/1963] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:10.994104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.003624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000dfb7-692e-482e-877c-2fb43d94a6f6 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.008546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.009203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.009489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.009768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.010527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:11.010839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.012441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.024578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 984/1964] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:11.033974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.044416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5791da8-7090-438f-97e3-c9e36100b84a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.049063 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.049729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.050048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.050328 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.051036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.053067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.058932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:11.154938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 981/1965] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:11 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:11.159224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.171332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4830d8c-c184-447b-87bc-0844c20d34ac admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.235044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.235806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.236090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.236374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.237072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.239136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.356531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 985/1966] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:11 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:11.360687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.371044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab87cc-262d-4d8a-8f25-9ad6cbcb88a9 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.375621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.376318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.376576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.376861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.377590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.379880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.390443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 982/1967] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:11.394529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.407200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d0273-0896-4bad-a932-7f0be5dd7ca2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.412404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77f10b-03ff-4d2d-a859-66fda42c1fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.413077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f10b-03ff-4d2d-a859-66fda42c1fff admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.413367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f10b-03ff-4d2d-a859-66fda42c1fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.413691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77f10b-03ff-4d2d-a859-66fda42c1fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.414435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77f10b-03ff-4d2d-a859-66fda42c1fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.416321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77f10b-03ff-4d2d-a859-66fda42c1fff admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.417603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:11.429470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 986/1968] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:11.433670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.445860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cbb99-7a3a-41aa-9832-a84e16786703 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.450695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.451626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.451939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.452216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] PATH_INFO: `/v3/projects/b029966a6c6a4c56afd09031db3cf068/users/d8385cf297594ca8872dace90c7c72b6/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.468807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b029966a6c6a4c56afd09031db3cf068, user_id=d8385cf297594ca8872dace90c7c72b6, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.472493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.542987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 983/1969] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:11 2022] PUT /identity/v3/projects/b029966a6c6a4c56afd09031db3cf068/users/d8385cf297594ca8872dace90c7c72b6/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:11.554276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.554478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.554743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.582196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] MFA Rules not processed for user `d8385cf297594ca8872dace90c7c72b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:11.584259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:11.650257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 987/1970] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:11.655129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.719585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46ede1-c607-454b-9543-60569262927a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.725062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.725760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.726081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.726365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.727082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.729071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:11.815715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 984/1971] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:11 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:11.820490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:11.831428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec800-16e6-40bd-818f-dd2133ec9fa9 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:11.894509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:11.894509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:11.894509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:11.894509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:11.897052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:11.897052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:12.014792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 988/1972] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:11 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:12.018746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:12.030663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc785199-1ca4-4e82-918b-f46d5c2f743a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:12.035310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:12.036141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:12.036428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:12.036732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:12.037460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:12.039178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:12.049612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 985/1973] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:12.053947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:12.064045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7c7c9-5103-444b-9d7d-9d9d02959a7e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:12.069897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:12.070837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:12.071127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:12.071408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] PATH_INFO: `/v3/projects/b289c8809a124dc59bba7ab2b76c5c0f/users/ad4bba19c11e4c2abbd20c6cccc817d6/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:12.087767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b289c8809a124dc59bba7ab2b76c5c0f, user_id=ad4bba19c11e4c2abbd20c6cccc817d6, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:12.090485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:12.247650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 989/1974] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:12 2022] PUT /identity/v3/projects/b289c8809a124dc59bba7ab2b76c5c0f/users/ad4bba19c11e4c2abbd20c6cccc817d6/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:12.253731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:12.265136 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50de7ff-0764-4682-9b46-c1fb353f6ad8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:12.335330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ed35-093c-43d7-80c6-512c88f20e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:12.336957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ed35-093c-43d7-80c6-512c88f20e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:12.336957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ed35-093c-43d7-80c6-512c88f20e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:12.336957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ed35-093c-43d7-80c6-512c88f20e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:12.337354 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ed35-093c-43d7-80c6-512c88f20e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:12.339036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ed35-093c-43d7-80c6-512c88f20e4e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:12.344464 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:12.353237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 986/1975] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:12.354487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:12.366193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0a5ce-1f98-4fa4-a22c-c8c7bfcc9cff admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:12.371122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:12.372023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:12.372308 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:12.372584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] PATH_INFO: `/v3/projects/b289c8809a124dc59bba7ab2b76c5c0f/users/ad4bba19c11e4c2abbd20c6cccc817d6/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:12.374632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b289c8809a124dc59bba7ab2b76c5c0f, user_id=ad4bba19c11e4c2abbd20c6cccc817d6, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:12.377302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:12.389395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 990/1976] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:12 2022] PUT /identity/v3/projects/b289c8809a124dc59bba7ab2b76c5c0f/users/ad4bba19c11e4c2abbd20c6cccc817d6/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:12.400360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:12.400655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:12.400939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:12.429738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] MFA Rules not processed for user `ad4bba19c11e4c2abbd20c6cccc817d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:12.430940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:12.503716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 987/1977] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:12.515931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:12.517825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:12.568016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:12.603893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a3f40-eff4-40d2-b889-6dfd2cdd5143 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:12.608186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:12.609075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:12.609448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:12.609820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:12.624483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:12.626013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:12.643064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 991/1978] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:13.029775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:13.032174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:13.054057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b87a7d-377f-4fa4-ae17-a4e0674dfa09 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:13.063785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7695f2-3aca-44e3-8eb5-6526ed4ed7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:13.066517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7695f2-3aca-44e3-8eb5-6526ed4ed7ad service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:13.067558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7695f2-3aca-44e3-8eb5-6526ed4ed7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:13.068311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7695f2-3aca-44e3-8eb5-6526ed4ed7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:13.187790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7695f2-3aca-44e3-8eb5-6526ed4ed7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:13.190106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7695f2-3aca-44e3-8eb5-6526ed4ed7ad service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:13.199884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 988/1979] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:16.201149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:16.202940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:16.271862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8454d5-4d1c-44b9-8f85-8bac554a771e service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:16.276917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:16.277813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:16.280271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:16.280271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] PATH_INFO: `/v3/users/9aeaa959f0d94fd6a95acf9b331571ce` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:16.280271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aeaa959f0d94fd6a95acf9b331571ce)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:16.281549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:16.520986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aeaa959f0d94fd6a95acf9b331571ce'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:16.533927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aeaa959f0d94fd6a95acf9b331571ce'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:16.631012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aeaa959f0d94fd6a95acf9b331571ce'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:16.631692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aeaa959f0d94fd6a95acf9b331571ce'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:16.641137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aeaa959f0d94fd6a95acf9b331571ce'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:16.649178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 992/1980] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:16 2022] DELETE /identity/v3/users/9aeaa959f0d94fd6a95acf9b331571ce => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:16.654041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:16.654480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:16.654645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:16.673934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:16.675281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:16.749364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 989/1981] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:16.759710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:16.761130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:16.819921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570520b-5551-482f-9ab5-6951a8c42a96 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:16.823765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:16.824425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:16.824741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:16.825082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:16.834840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:16.836344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:16.851546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 993/1982] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:17.423481 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:17.425070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:17.443225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb9767-023a-4025-9829-90102f4a9fb7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:17.448958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:17.451419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:17.451895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:17.452507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] PATH_INFO: `/v3/projects/d092764caf504b18806bc2515c010937` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:17.453750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d092764caf504b18806bc2515c010937)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:17.455737 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:17.480504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:17.596132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd092764caf504b18806bc2515c010937', 'request_id': 'req-6374b074-0a16-41c6-bd03-c8c65e028408'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:17.605333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd092764caf504b18806bc2515c010937', 'request_id': 'req-6374b074-0a16-41c6-bd03-c8c65e028408'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:17.612756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd092764caf504b18806bc2515c010937', 'request_id': 'req-6374b074-0a16-41c6-bd03-c8c65e028408'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:17.701402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] The token cache is being invalidate because project d092764caf504b18806bc2515c010937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:17.702323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:17.703128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:17.705005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 990/1983] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:17 2022] DELETE /identity/v3/projects/d092764caf504b18806bc2515c010937 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:17.708859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:17.713937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:17.720691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fca929-d7a9-4bd1-8b00-05e17f342246 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:17.831804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:17.832586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:17.832874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:17.833152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] PATH_INFO: `/v3/users/04b16a1bf24c4d91aacd0eb6bfa981b5` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:17.834496 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b16a1bf24c4d91aacd0eb6bfa981b5)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:17.836993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:18.020648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:18.022190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:18.037127 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374b074-0a16-41c6-bd03-c8c65e028408 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:18.041782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:18.042664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:18.042947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:18.043220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] PATH_INFO: `/v3/users/d4effde578404859b857afcf408db792` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:18.044406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4effde578404859b857afcf408db792)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:18.046748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:18.125571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b16a1bf24c4d91aacd0eb6bfa981b5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.142030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b16a1bf24c4d91aacd0eb6bfa981b5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.203046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b16a1bf24c4d91aacd0eb6bfa981b5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.203681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b16a1bf24c4d91aacd0eb6bfa981b5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.214878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3dee27a0-0cda-45c8-9313-1745d22e7ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b16a1bf24c4d91aacd0eb6bfa981b5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.229462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 994/1984] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:17 2022] DELETE /identity/v3/users/04b16a1bf24c4d91aacd0eb6bfa981b5 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:18.283471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4effde578404859b857afcf408db792'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.312885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4effde578404859b857afcf408db792'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.358703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4effde578404859b857afcf408db792'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.359588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4effde578404859b857afcf408db792'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.360483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4effde578404859b857afcf408db792'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:18.489416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 991/1985] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:18 2022] DELETE /identity/v3/users/d4effde578404859b857afcf408db792 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:18.494277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:18.494577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:18.494861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:18.513627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:18.514842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:18.609687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 995/1986] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:18.623778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:18.625922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:18.705745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6496506-baf0-430d-bd83-8c8913fc568c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:18.713531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcff11-b9d4-4d33-9f05-6cafd1d8cda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:18.714200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcff11-b9d4-4d33-9f05-6cafd1d8cda5 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:18.714658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcff11-b9d4-4d33-9f05-6cafd1d8cda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:18.714949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcff11-b9d4-4d33-9f05-6cafd1d8cda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:18.727411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcff11-b9d4-4d33-9f05-6cafd1d8cda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:18.730238 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcff11-b9d4-4d33-9f05-6cafd1d8cda5 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:18.753217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 992/1987] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:18.823718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:18.825317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:18.838175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28d1b0-d563-40a0-b768-bc92f85812fc None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:18.843318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:18.844477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:18.844988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:18.845695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] PATH_INFO: `/v3/projects/b85f7a5fbe2949cb9dabbfcc9a91145a` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:18.853898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85f7a5fbe2949cb9dabbfcc9a91145a)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:18.857999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:18.879701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:19.011871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85f7a5fbe2949cb9dabbfcc9a91145a', 'request_id': 'req-628a0e3b-129d-4029-a1a8-4c96aca3a87f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.077918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85f7a5fbe2949cb9dabbfcc9a91145a', 'request_id': 'req-628a0e3b-129d-4029-a1a8-4c96aca3a87f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.087875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85f7a5fbe2949cb9dabbfcc9a91145a', 'request_id': 'req-628a0e3b-129d-4029-a1a8-4c96aca3a87f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.106376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] The token cache is being invalidate because project b85f7a5fbe2949cb9dabbfcc9a91145a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:19.106970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.108279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-628a0e3b-129d-4029-a1a8-4c96aca3a87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.110408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 996/1988] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:18 2022] DELETE /identity/v3/projects/b85f7a5fbe2949cb9dabbfcc9a91145a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:19.115882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.116838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.117277 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.150306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:19.152147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:19.175729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:19.242458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 993/1989] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:19.244646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.245152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.245612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.266516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:19.267997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:19.283275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.287741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 997/1990] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:19.294794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b184ab-ee8b-4a45-a5df-029d8b22ae7a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:19.301699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:19.315909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.316309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.316715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.317678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:19.318016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:19.323785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:19.342337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 994/1991] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:19.343392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.365050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9944-3613-4018-91db-fd188df29cda None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:19.378522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:19.385776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.386116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.386368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.387246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:19.389136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:19.510419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 998/1992] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:19 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:19.512271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.545657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.549717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:19.550420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318a3c-8b5a-44cf-a10a-058ba6d7653b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:19.700011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:19.700954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.701390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.701953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.702955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:19.705048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:19.711611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31c965-0eb3-4421-9e44-7eb87bb84985 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:19.716426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:19.717492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.724312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.724312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] PATH_INFO: `/v3/projects/f53a5dacd32e4be8aa147a466694f52a` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.724312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53a5dacd32e4be8aa147a466694f52a)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:19.724312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:19.843204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 995/1993] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:19 2022] POST /identity/v3/users => generated 291 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:19.847169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.858995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d944ced-c677-4fc9-9c3f-f2709e82fd83 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:19.864894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:19.865842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.867569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.867569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.867569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:19.870875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:19.885530 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 996/1994] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:19.890415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.894196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53a5dacd32e4be8aa147a466694f52a', 'request_id': 'req-e06fda0d-25ff-45d5-b593-7232e6555e31'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.905827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909ac7f-593f-4e88-b17d-062080688a96 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:19.972622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53a5dacd32e4be8aa147a466694f52a', 'request_id': 'req-e06fda0d-25ff-45d5-b593-7232e6555e31'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.973513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:19.974304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:19.974597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:19.974878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:19.975632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:19.977281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:19.981674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53a5dacd32e4be8aa147a466694f52a', 'request_id': 'req-e06fda0d-25ff-45d5-b593-7232e6555e31'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.991837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 997/1995] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:19.992913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:19.996434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] The token cache is being invalidate because project f53a5dacd32e4be8aa147a466694f52a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:19.999587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.999587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:19.999587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 999/1996] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:19 2022] DELETE /identity/v3/projects/f53a5dacd32e4be8aa147a466694f52a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:20.003432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.004374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385b3ee-5f4a-44cd-bcc9-35781d358855 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.005010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:20.009475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7a784-5eba-4760-b536-25788f1216ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.011379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a784-5eba-4760-b536-25788f1216ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.011379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a784-5eba-4760-b536-25788f1216ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.011561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7a784-5eba-4760-b536-25788f1216ca admin admin] PATH_INFO: `/v3/projects/0e36ee23fa3349438e619d8735e74a0d/users/39263b16c91542b199b0a02e6ad7f3f5/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.022546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fda0d-25ff-45d5-b593-7232e6555e31 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.033076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.033076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.033076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.033076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] PATH_INFO: `/v3/users/ab8a3cbad69d42d7980362e6efec0460` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.033429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a784-5eba-4760-b536-25788f1216ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e36ee23fa3349438e619d8735e74a0d, user_id=39263b16c91542b199b0a02e6ad7f3f5, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.033512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8a3cbad69d42d7980362e6efec0460)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.033701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7a784-5eba-4760-b536-25788f1216ca admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.034164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.105398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 998/1997] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:19 2022] PUT /identity/v3/projects/0e36ee23fa3349438e619d8735e74a0d/users/39263b16c91542b199b0a02e6ad7f3f5/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:20.116970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.117263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.117641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.149947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] MFA Rules not processed for user `39263b16c91542b199b0a02e6ad7f3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:20.150375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:20.214537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8a3cbad69d42d7980362e6efec0460'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.226682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8a3cbad69d42d7980362e6efec0460'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.227362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 999/1998] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:20.233095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.234598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:20.293080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8a3cbad69d42d7980362e6efec0460'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.294117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8a3cbad69d42d7980362e6efec0460'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.309463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8a3cbad69d42d7980362e6efec0460'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.318697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1000/1999] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:20 2022] DELETE /identity/v3/users/ab8a3cbad69d42d7980362e6efec0460 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:20.324770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783d934-bf56-4fbd-94ab-d719286afac0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.399991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.400850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.401297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.401990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.402946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.405276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.409837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:20.437329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.438900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:20.469327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2268a1-2242-495d-b72b-e0cd89b39d9d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.481373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.482409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.482772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.483133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] PATH_INFO: `/v3/users/d8385cf297594ca8872dace90c7c72b6` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.484421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8385cf297594ca8872dace90c7c72b6)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.486707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.529763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1000/2000] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:20 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:20.533637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.535597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:20.612699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138eb7-acdc-4f10-8848-9d1920398f7b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.618040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.618662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.618962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.619249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.619956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.622177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.773666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1001/2001] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:20 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:20.775281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.786225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8385cf297594ca8872dace90c7c72b6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.788644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1bb8e4-4111-4368-9c71-0c6a84219c8e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.795183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.795461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.795821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.796170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.797065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.799153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.814073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1002/2002] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:20.815620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.825132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8385cf297594ca8872dace90c7c72b6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.831381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2103633-2abe-40b0-a36d-e8daf6eb80fd admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:20.838292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:20.839126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.839535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.840002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] PATH_INFO: `/v3/projects/450d633a4ef74ee798b34b5d69993b17/users/e48ecfb0b69c42a8806bc2857b83fca3/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.861145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] RBAC: Authorizing `identity:create_grant(project_id=450d633a4ef74ee798b34b5d69993b17, user_id=e48ecfb0b69c42a8806bc2857b83fca3, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:20.866244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:20.928770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8385cf297594ca8872dace90c7c72b6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.929522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8385cf297594ca8872dace90c7c72b6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.937904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e83bd72d-7d91-4c6e-8fde-434dfbe12d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8385cf297594ca8872dace90c7c72b6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:20.945561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1001/2003] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:20 2022] DELETE /identity/v3/users/d8385cf297594ca8872dace90c7c72b6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:20.954535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:20.963003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1003/2004] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:20 2022] PUT /identity/v3/projects/450d633a4ef74ee798b34b5d69993b17/users/e48ecfb0b69c42a8806bc2857b83fca3/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:20.963318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:20.963318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:20.964021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:20.969667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:20.984518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:20.985774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.085509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1002/2005] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:21.088830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.090210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.105250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0874a3e-514c-47be-a128-5bb480158c27 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.110293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.111349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.111641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.111924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] PATH_INFO: `/v3/projects/9f623171c8f24807a3a03ac445a57df9` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.113185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f623171c8f24807a3a03ac445a57df9)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.115489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.124505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:21.144496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92c11d-daf2-47df-9b15-47e997fe986a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.156138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.156989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.157303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.157606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.158529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.160230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.173932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1004/2006] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:21.173932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.177255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.251966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a39c-e678-4964-a3c0-8447b5ce598a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.257083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.257862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.258696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.259054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.273188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.275503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.280015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f623171c8f24807a3a03ac445a57df9', 'request_id': 'req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:21.293524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1005/2007] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:21.294549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.308418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9609675-7fa7-4f94-b050-11fc6ad18035 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.358724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f623171c8f24807a3a03ac445a57df9', 'request_id': 'req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:21.370324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f623171c8f24807a3a03ac445a57df9', 'request_id': 'req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:21.421930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05409740-f618-4d08-832b-2a53c96b4fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.423042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409740-f618-4d08-832b-2a53c96b4fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.423346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409740-f618-4d08-832b-2a53c96b4fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.423753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409740-f618-4d08-832b-2a53c96b4fbb admin admin] PATH_INFO: `/v3/projects/450d633a4ef74ee798b34b5d69993b17/users/e48ecfb0b69c42a8806bc2857b83fca3/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.427321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05409740-f618-4d08-832b-2a53c96b4fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=450d633a4ef74ee798b34b5d69993b17, user_id=e48ecfb0b69c42a8806bc2857b83fca3, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.430289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05409740-f618-4d08-832b-2a53c96b4fbb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.435577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] The token cache is being invalidate because project 9f623171c8f24807a3a03ac445a57df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:21.435893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:21.439753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-50797ecb-6717-4a4d-ac5d-97ed7fa6bdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:21.446283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1003/2008] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:21 2022] DELETE /identity/v3/projects/9f623171c8f24807a3a03ac445a57df9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:21.447304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1006/2009] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:21 2022] PUT /identity/v3/projects/450d633a4ef74ee798b34b5d69993b17/users/e48ecfb0b69c42a8806bc2857b83fca3/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:21.451383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fedc4-7508-45e8-914e-6498024270be None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.451767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fedc4-7508-45e8-914e-6498024270be None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.452053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3fedc4-7508-45e8-914e-6498024270be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.458655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.460973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.460973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.480970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8a3fedc4-7508-45e8-914e-6498024270be None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:21.482279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8a3fedc4-7508-45e8-914e-6498024270be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.499143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] MFA Rules not processed for user `e48ecfb0b69c42a8806bc2857b83fca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:21.500388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.603396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1007/2010] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:21.611535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.611894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.616058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.648323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1004/2011] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:21.670183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.675131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.691017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:21.692993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.698728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:21.707133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1008/2012] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:21.712271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.724221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bd12a-f533-4380-93f6-d1608719e489 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.735406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.735406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.735406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.735406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.735849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:21.735849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.735849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.756186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1009/2013] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:21.760637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.764666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:21.791582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a636d5b-c551-4739-9d85-9abe349941d4 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.802323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.803079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.803617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.804553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.806213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.816863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.818550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9d10b-31a0-41ae-befe-d409380608e1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.830499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.831729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.833642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.834454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:21.868311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:21.869932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:21.887253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1005/2014] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:21.965253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:21.970049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:21.990713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595fe33-fe4d-4ce3-94f1-1134c30eee36 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:21.997661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:21.998921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:21.999495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:21.999956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] PATH_INFO: `/v3/projects/b029966a6c6a4c56afd09031db3cf068` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.001511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b029966a6c6a4c56afd09031db3cf068)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.006734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1010/2015] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:21 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:22.007274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.008688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.115051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab8d46-32b4-4031-9823-deaf63a637b2 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.122534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.124174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.127518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.127518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.127518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.128468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.184778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b029966a6c6a4c56afd09031db3cf068', 'request_id': 'req-18299367-b433-4925-ae27-c02e37763a64'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.247456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1011/2016] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:22 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:22.249489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.275467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b029966a6c6a4c56afd09031db3cf068', 'request_id': 'req-18299367-b433-4925-ae27-c02e37763a64'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.282694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b029966a6c6a4c56afd09031db3cf068', 'request_id': 'req-18299367-b433-4925-ae27-c02e37763a64'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.296626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] The token cache is being invalidate because project b029966a6c6a4c56afd09031db3cf068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:22.296936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.298045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.299633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1006/2017] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:21 2022] DELETE /identity/v3/projects/b029966a6c6a4c56afd09031db3cf068 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:22.300556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.302986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:22.318753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb6bd-1ccc-4284-aa35-7e29773fcaca admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.371079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18299367-b433-4925-ae27-c02e37763a64 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.376185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.376868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.377150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.377423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.378109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.378253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.379072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.379430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.379783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.380473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.381944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:22.391363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1007/2018] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:22.392060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.394278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:22.407882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb381f-adad-44de-b7e1-ac3458ad760d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.414307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.419621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.419621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.419621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] PATH_INFO: `/v3/users/ad4bba19c11e4c2abbd20c6cccc817d6` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.419621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4bba19c11e4c2abbd20c6cccc817d6)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.419621 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.456029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.459181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.470923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1012/2019] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:22.470923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.482938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c966ff8-25fb-4de2-8992-342be46ad832 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.490988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c6e59-e767-4cb0-aa28-003ad05dd19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.491715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6e59-e767-4cb0-aa28-003ad05dd19b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.492020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6e59-e767-4cb0-aa28-003ad05dd19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.492288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6e59-e767-4cb0-aa28-003ad05dd19b admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.493022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c6e59-e767-4cb0-aa28-003ad05dd19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.494685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c6e59-e767-4cb0-aa28-003ad05dd19b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.508732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1013/2020] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:22.508732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bbed8-71c1-4447-967f-2fe9b29df4f6 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.508732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bbed8-71c1-4447-967f-2fe9b29df4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.508732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bbed8-71c1-4447-967f-2fe9b29df4f6 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.509235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1014/2021] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:24:22.509902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bbed8-71c1-4447-967f-2fe9b29df4f6 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.523389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bbed8-71c1-4447-967f-2fe9b29df4f6 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.528499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44548f3-2857-4eab-abfc-24e997ba2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.529374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44548f3-2857-4eab-abfc-24e997ba2d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.529662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44548f3-2857-4eab-abfc-24e997ba2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.530025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44548f3-2857-4eab-abfc-24e997ba2d2f admin admin] PATH_INFO: `/v3/projects/09e8db6123ba41aaacbffd660ef4b261/users/521ea2680ac24d1e811a6fb7423dc371/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.548360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44548f3-2857-4eab-abfc-24e997ba2d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e8db6123ba41aaacbffd660ef4b261, user_id=521ea2680ac24d1e811a6fb7423dc371, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.552132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44548f3-2857-4eab-abfc-24e997ba2d2f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.659013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4bba19c11e4c2abbd20c6cccc817d6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.671992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1015/2022] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:22 2022] PUT /identity/v3/projects/09e8db6123ba41aaacbffd660ef4b261/users/521ea2680ac24d1e811a6fb7423dc371/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:22.672999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4bba19c11e4c2abbd20c6cccc817d6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.683924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.684193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.684432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.703471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] MFA Rules not processed for user `d290657114cf4e8992cba9c10a6c7713`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:22.706345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:22.772805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1016/2023] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:22.773653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.775149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:22.818599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4bba19c11e4c2abbd20c6cccc817d6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.819238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4bba19c11e4c2abbd20c6cccc817d6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.827031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4ba6215b-393a-4b19-98cf-a4db1ffc5f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4bba19c11e4c2abbd20c6cccc817d6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:22.833167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1008/2024] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:22 2022] DELETE /identity/v3/users/ad4bba19c11e4c2abbd20c6cccc817d6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:22.834463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.834750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.835032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.843814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a6610-e5bf-43d5-96dc-b6463bfbb40c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:22.862885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] MFA Rules not processed for user `521ea2680ac24d1e811a6fb7423dc371`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:22.865089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:22.907002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:22.907909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:22.908196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:22.908466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] PATH_INFO: `/v3/users/03102ea04c0e42b19576f1800f8cc6e9` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:22.909783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=03102ea04c0e42b19576f1800f8cc6e9)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:22.912570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:22.937201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1009/2025] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:22.937892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:22.939600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.008922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:23.009511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b703c-cc80-4cbc-8f3f-c7791a327849 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.014924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.015618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.017629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.017629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.017994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.031258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.032950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.045122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1010/2026] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:23.046259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.047864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.084183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b6a3d-4569-4838-a62d-61497a00dcad service placement] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.089506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.090331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.090613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.090892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.091598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.098076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.210726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03102ea04c0e42b19576f1800f8cc6e9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.224636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03102ea04c0e42b19576f1800f8cc6e9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.231537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03102ea04c0e42b19576f1800f8cc6e9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.232260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03102ea04c0e42b19576f1800f8cc6e9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.232876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03102ea04c0e42b19576f1800f8cc6e9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.249929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1011/2027] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:23 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:23.252185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.255302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.322870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fff6a-5f91-49ea-8023-202053a000ab admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.328861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.329477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.329766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.330078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.330813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.333207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.339518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1017/2028] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:22 2022] DELETE /identity/v3/users/03102ea04c0e42b19576f1800f8cc6e9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:23.339518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.341287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.449053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:23.463082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee8444-7195-48e7-bd73-7e3214e75f3b admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.467575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.468433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.468713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.468990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] PATH_INFO: `/v3/projects/b289c8809a124dc59bba7ab2b76c5c0f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.473944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b289c8809a124dc59bba7ab2b76c5c0f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.473944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.511848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1012/2029] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:23 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:23.515844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.528411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0b84c-c76e-4809-83bb-76aa8d6a79ca admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.544135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.544841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.545128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.545449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.546184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.547807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.562148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1013/2030] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:23.565283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.575845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7e395-0bd1-4729-94e8-1626d821fd7c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.580772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.581605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.582458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.582741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] PATH_INFO: `/v3/projects/7b424d0dde9343ddaa283666c3190f4e/users/74db505475a94361840c94c5e4f81eee/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.598684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b424d0dde9343ddaa283666c3190f4e, user_id=74db505475a94361840c94c5e4f81eee, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.601432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.730385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1014/2031] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:23 2022] PUT /identity/v3/projects/7b424d0dde9343ddaa283666c3190f4e/users/74db505475a94361840c94c5e4f81eee/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:23.731432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.733375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.738705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b289c8809a124dc59bba7ab2b76c5c0f', 'request_id': 'req-b73fa90b-6eba-4678-bd7c-145050434fc6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.753012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b289c8809a124dc59bba7ab2b76c5c0f', 'request_id': 'req-b73fa90b-6eba-4678-bd7c-145050434fc6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.763356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b289c8809a124dc59bba7ab2b76c5c0f', 'request_id': 'req-b73fa90b-6eba-4678-bd7c-145050434fc6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.802765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec0315-08d4-446e-8c8b-dc9159e8adcd admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.830975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] The token cache is being invalidate because project b289c8809a124dc59bba7ab2b76c5c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:23.831228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.832053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:23.835630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1018/2032] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:23 2022] DELETE /identity/v3/projects/b289c8809a124dc59bba7ab2b76c5c0f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:23.835630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.839225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.871772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.872649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.872932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.873208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] PATH_INFO: `/v3/projects/a3499b45946141ff9177a6f3bbf01d3d` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.874456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3499b45946141ff9177a6f3bbf01d3d)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.876409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.915817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa90b-6eba-4678-bd7c-145050434fc6 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.920611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1ce0f-e366-4dd0-abf9-574b4c718880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:23.921307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ce0f-e366-4dd0-abf9-574b4c718880 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.921592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ce0f-e366-4dd0-abf9-574b4c718880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.921910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1ce0f-e366-4dd0-abf9-574b4c718880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.922640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1ce0f-e366-4dd0-abf9-574b4c718880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:23.924253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1ce0f-e366-4dd0-abf9-574b4c718880 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:23.934406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1019/2033] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:23.935782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:23.936084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:23.936552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:23.956089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:23.958211 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:23.966142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1020/2034] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:23.966930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:23.982493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116919b-1393-4dca-b2b1-896600f6aadc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:23.990053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3499b45946141ff9177a6f3bbf01d3d', 'request_id': 'req-be5da3b5-ab8e-4857-b573-d9306dc7b347'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:24.040578 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fb122-6017-4100-8ac2-c088e5bfc3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.041547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb122-6017-4100-8ac2-c088e5bfc3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.041854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb122-6017-4100-8ac2-c088e5bfc3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.042142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fb122-6017-4100-8ac2-c088e5bfc3d6 admin admin] PATH_INFO: `/v3/projects/7b424d0dde9343ddaa283666c3190f4e/users/74db505475a94361840c94c5e4f81eee/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.044157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fb122-6017-4100-8ac2-c088e5bfc3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b424d0dde9343ddaa283666c3190f4e, user_id=74db505475a94361840c94c5e4f81eee, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.046963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fb122-6017-4100-8ac2-c088e5bfc3d6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.057325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1021/2035] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:23 2022] PUT /identity/v3/projects/7b424d0dde9343ddaa283666c3190f4e/users/74db505475a94361840c94c5e4f81eee/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:24.058606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780894cf-1c1f-40f1-b02b-3281cf0fbc3c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.058900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780894cf-1c1f-40f1-b02b-3281cf0fbc3c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.059184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780894cf-1c1f-40f1-b02b-3281cf0fbc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.076935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3499b45946141ff9177a6f3bbf01d3d', 'request_id': 'req-be5da3b5-ab8e-4857-b573-d9306dc7b347'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:24.079533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-780894cf-1c1f-40f1-b02b-3281cf0fbc3c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:24.080757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-780894cf-1c1f-40f1-b02b-3281cf0fbc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.092312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3499b45946141ff9177a6f3bbf01d3d', 'request_id': 'req-be5da3b5-ab8e-4857-b573-d9306dc7b347'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:24.098520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] The token cache is being invalidate because project a3499b45946141ff9177a6f3bbf01d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:24.098843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:24.099546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-be5da3b5-ab8e-4857-b573-d9306dc7b347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:24.101131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1015/2036] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:23 2022] DELETE /identity/v3/projects/a3499b45946141ff9177a6f3bbf01d3d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:24.105668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.105991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.106277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.133262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] MFA Rules not processed for user `74db505475a94361840c94c5e4f81eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:24.134584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.147964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1022/2037] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:24.147964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.147964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.147964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.164995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:24.166237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.174428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1023/2038] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:24.175220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.184954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab28fd7-be58-48e6-80fb-515898fbfcdf None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.190357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.191024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.191435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.191706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.192619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:24.192931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.194586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75db035-5dd4-408e-a76d-ce6e876f22d4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.207496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1024/2039] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:24.211870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1016/2040] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:24.212030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.212030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.212030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.220008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.224892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.228820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:24.230224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.232981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:24.243110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1025/2041] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:24.244300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.254864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ca7c0-c2d1-4cb8-959b-f261f716af92 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.260379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.261042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.261330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.261904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.262450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.264685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.298124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9b5c3-9863-46d4-9795-821b2517e02d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.301864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.302598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.302874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.303201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.313162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.315079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.325269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1017/2042] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:24.326122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.337000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad6c18-28ec-4826-b609-ca273078484e service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.342457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.343049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.343330 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.343658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.344392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:24.344700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.346478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.359926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1018/2043] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:24.364247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.375152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6176c-00e1-472e-9695-26a6a8c273db admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.381215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.381989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.382335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.382792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.382943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1026/2044] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:24.383579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.385585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.387309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.457662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d7283-9a24-499d-96d2-2f341cbb8b3e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.462827 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.463528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.463933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.464218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.464923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.466917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.493710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1019/2045] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:24.497764 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.570510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e3ba0-5df8-4495-a125-8f5cb958b23c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.576543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.577232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.577519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.577824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.578524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.580458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.601175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1027/2046] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:24.608963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.623699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07d108-ab8b-4194-ac05-bfc96e321b4a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.628621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.630164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.630584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.630802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.631566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.633187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.647950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1028/2047] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:24.649149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.664167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f995a5a-8696-400b-83c8-1da859620b67 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.668895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.669672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.670028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.670387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.671164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.672860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.683378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1020/2048] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:24.684662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1029/2049] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:24.689069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.690829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.700389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91900c2e-c48a-484d-8a08-53a7239df449 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.701195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07974c9e-1cce-414e-bf6d-814f78ac5609 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.708262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.709199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.715272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.715272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.715673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815fa9e-e516-4b0b-8f53-e2bd10ac5c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.715791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.715880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815fa9e-e516-4b0b-8f53-e2bd10ac5c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.715880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815fa9e-e516-4b0b-8f53-e2bd10ac5c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.715880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815fa9e-e516-4b0b-8f53-e2bd10ac5c6a admin admin] PATH_INFO: `/v3/projects/31e9c32c2a624957ad3a7e1e9b0356cc/users/453d6ddb1e2443859d9e2be9ce2001ad/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.716121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.723541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1030/2050] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:24.726903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.732482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815fa9e-e516-4b0b-8f53-e2bd10ac5c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e9c32c2a624957ad3a7e1e9b0356cc, user_id=453d6ddb1e2443859d9e2be9ce2001ad, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.735415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815fa9e-e516-4b0b-8f53-e2bd10ac5c6a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.736746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf737c9-c7b9-462a-9ffe-910fd74d9da8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.742299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.743054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.743399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.743741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.744527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.746227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.757790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1031/2051] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:24.762230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.772703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230220c6-0719-4fb6-a1fe-0dabf581ec6e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:24.777894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a2e8d-a181-4767-b1af-eaacd57d2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:24.778848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a2e8d-a181-4767-b1af-eaacd57d2e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.779150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a2e8d-a181-4767-b1af-eaacd57d2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.779597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a2e8d-a181-4767-b1af-eaacd57d2e31 admin admin] PATH_INFO: `/v3/projects/82b1c37968154eb0909c16db5226cbab/users/b756232b9dae44bd804f7c9c3bf1e1a3/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.794606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a2e8d-a181-4767-b1af-eaacd57d2e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b1c37968154eb0909c16db5226cbab, user_id=b756232b9dae44bd804f7c9c3bf1e1a3, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:24.797302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a2e8d-a181-4767-b1af-eaacd57d2e31 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:24.842813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1021/2052] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:24 2022] PUT /identity/v3/projects/31e9c32c2a624957ad3a7e1e9b0356cc/users/453d6ddb1e2443859d9e2be9ce2001ad/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:24.854196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.854196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.854196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.864431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1032/2053] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:24 2022] PUT /identity/v3/projects/82b1c37968154eb0909c16db5226cbab/users/b756232b9dae44bd804f7c9c3bf1e1a3/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:24.876279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:24.877074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:24.878011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:24.884171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] MFA Rules not processed for user `453d6ddb1e2443859d9e2be9ce2001ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:24.885359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.906170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:24.908273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] MFA Rules not processed for user `b756232b9dae44bd804f7c9c3bf1e1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:24.909476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:24.959494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1022/2054] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:24.964104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:24.988219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1033/2055] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:24.993295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.043394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08ffac-878b-41f4-a83c-822d66bb6364 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.048153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.048817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.049099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.049368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.050088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.053030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.067633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a8a3a-ee75-47f3-887b-5718b752ee09 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.072631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.073301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.073588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.073902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.074598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.076566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.100309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:25.190690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1023/2056] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:25.195238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.195522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1034/2057] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:24 2022] POST /identity/v3/projects => generated 389 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:25.196435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.262161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0cd7f-59d1-4d52-9483-524d2e4b207b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.262830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443f178-b7f1-48d9-a467-a3e1dee830c2 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.267460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.267630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.267973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.268089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.268178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.268355 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.268456 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.268625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.269147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.269412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.271182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.274473 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.445730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1035/2058] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:25 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:25.449601 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.452461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1024/2059] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:25 2022] POST /identity/v3/users => generated 296 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:25.456194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.465137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68081e6-091e-40ef-bfec-de48aabae9cb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.469082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e45402-e76d-4ccc-9f72-8898943b34cb admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.471589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.473305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.473665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.474082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.475071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.481251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.481373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.481373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.481373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.481373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.481749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.483319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.491572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1036/2060] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:25.500911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.509429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1025/2061] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:25.512126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.517882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633befeb-1770-470a-96e2-a7a0866d2ce5 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.524164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.525506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.526169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.527265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] PATH_INFO: `/v3/projects/f2971ce05be042d3aeb6fd0335e9dc16/users/946833ee92134b35bcdba1598a3324dd/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.533035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c7eea-562b-481b-bc69-a01b4e5206fe admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.544112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.545017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.545304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.545590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] PATH_INFO: `/v3/projects/e405ac57f0414ae98c30b7a4480b6e2b/users/0f61fb50ab994d07bd6fb84726cf9a1a/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.562912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2971ce05be042d3aeb6fd0335e9dc16, user_id=946833ee92134b35bcdba1598a3324dd, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.565590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.566933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e405ac57f0414ae98c30b7a4480b6e2b, user_id=0f61fb50ab994d07bd6fb84726cf9a1a, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.569980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.675160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1037/2062] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:25 2022] PUT /identity/v3/projects/f2971ce05be042d3aeb6fd0335e9dc16/users/946833ee92134b35bcdba1598a3324dd/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:25.679544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.693915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:25.698483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1026/2063] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:25 2022] PUT /identity/v3/projects/e405ac57f0414ae98c30b7a4480b6e2b/users/0f61fb50ab994d07bd6fb84726cf9a1a/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:25.704420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.747506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df1143-87ed-4a5d-a1f7-8cfb3712d301 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.772031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91dddf-0981-40e3-9bb2-abd6980941f5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.778885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.779566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.779896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.780118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.780847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.782562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.797212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1027/2064] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:25.798399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.807790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:25.811583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3da05-e248-4b7b-a14d-705e0f0d2981 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.817339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb63bb-722e-431a-8d6d-c3f834d727ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.818201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb63bb-722e-431a-8d6d-c3f834d727ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.818483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb63bb-722e-431a-8d6d-c3f834d727ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.818760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb63bb-722e-431a-8d6d-c3f834d727ec admin admin] PATH_INFO: `/v3/projects/e405ac57f0414ae98c30b7a4480b6e2b/users/0f61fb50ab994d07bd6fb84726cf9a1a/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.820870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb63bb-722e-431a-8d6d-c3f834d727ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e405ac57f0414ae98c30b7a4480b6e2b, user_id=0f61fb50ab994d07bd6fb84726cf9a1a, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.827458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb63bb-722e-431a-8d6d-c3f834d727ec admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.830704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.831472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.832632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.833152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.834381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.836139 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.841871 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1028/2065] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:25 2022] PUT /identity/v3/projects/e405ac57f0414ae98c30b7a4480b6e2b/users/0f61fb50ab994d07bd6fb84726cf9a1a/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:25.848723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.849138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.849491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.854153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1038/2066] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:25.858153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.868907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c3a6-92ec-43ac-8ae2-953478c91ade admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:25.882305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] MFA Rules not processed for user `0f61fb50ab994d07bd6fb84726cf9a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:25.884069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:25.925700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52539b0-d8bf-4a01-8311-c876b0f9a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:25.926836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52539b0-d8bf-4a01-8311-c876b0f9a7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.927120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52539b0-d8bf-4a01-8311-c876b0f9a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.927396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52539b0-d8bf-4a01-8311-c876b0f9a7ae admin admin] PATH_INFO: `/v3/projects/f2971ce05be042d3aeb6fd0335e9dc16/users/946833ee92134b35bcdba1598a3324dd/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.929390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52539b0-d8bf-4a01-8311-c876b0f9a7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2971ce05be042d3aeb6fd0335e9dc16, user_id=946833ee92134b35bcdba1598a3324dd, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:25.932058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52539b0-d8bf-4a01-8311-c876b0f9a7ae admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:25.942369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1039/2067] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:25 2022] PUT /identity/v3/projects/f2971ce05be042d3aeb6fd0335e9dc16/users/946833ee92134b35bcdba1598a3324dd/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:25.953471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:25.953828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:25.954142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:25.959971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1029/2068] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:25.979065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:25.984395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] MFA Rules not processed for user `946833ee92134b35bcdba1598a3324dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:25.986065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.046580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f579a-16e5-421a-aa1d-8b3ee3ba4d46 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:26.078916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1040/2069] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:26.112126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:26.120534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:26.121228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.122033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.122033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.137499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:26.139058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.184575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:26.187616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:26.189234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:26.199658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1030/2070] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:26.200476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:26.202100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.213468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0858740-bf1e-4534-a0c1-d78ec5c17e94 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:26.213617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43522-ffcc-4cf4-864b-79d6a2a193bc service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:26.217455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:26.218138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.218517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.218800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.218966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:26.220195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.220480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.220759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] PATH_INFO: `/v3/users/39263b16c91542b199b0a02e6ad7f3f5` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.222000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39263b16c91542b199b0a02e6ad7f3f5)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:26.223979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:26.228702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:26.230183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:26.240750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1031/2071] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:26.434809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:26.448133 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831b7d-3539-402c-b5e4-f3aaa5bc4dcb service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:26.452802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:26.453772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.454042 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.454324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] PATH_INFO: `/v3/users/b756232b9dae44bd804f7c9c3bf1e1a3` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.455711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b756232b9dae44bd804f7c9c3bf1e1a3)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:26.458027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:26.512735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39263b16c91542b199b0a02e6ad7f3f5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.525619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39263b16c91542b199b0a02e6ad7f3f5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.532923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39263b16c91542b199b0a02e6ad7f3f5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.533659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39263b16c91542b199b0a02e6ad7f3f5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.534287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-357b89a1-cd15-4945-88dd-837855316583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39263b16c91542b199b0a02e6ad7f3f5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.695010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1041/2072] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:26 2022] DELETE /identity/v3/users/39263b16c91542b199b0a02e6ad7f3f5 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:26.699439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.699740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.700526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.717902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b756232b9dae44bd804f7c9c3bf1e1a3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.719259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:26.720480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.738802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b756232b9dae44bd804f7c9c3bf1e1a3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.776131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:26.812946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1042/2073] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:26.813790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:26.815042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.827393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbe157-6b7e-435e-9680-38cc7765435a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:26.829619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b756232b9dae44bd804f7c9c3bf1e1a3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.830369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b756232b9dae44bd804f7c9c3bf1e1a3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.833171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:26.834080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.838364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.838364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] PATH_INFO: `/v3/users/453d6ddb1e2443859d9e2be9ce2001ad` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.838364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453d6ddb1e2443859d9e2be9ce2001ad)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:26.838364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:26.838674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b756232b9dae44bd804f7c9c3bf1e1a3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:26.844550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1032/2074] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:26 2022] DELETE /identity/v3/users/b756232b9dae44bd804f7c9c3bf1e1a3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:26.845397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:26.846765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.910922 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879d36-6273-4198-b682-0ff09a9dc7ab admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:26.914655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:26.915435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.915650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:26.915929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:26.918800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:26.943179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:26.985088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:26.986662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963a9f2-e38d-4587-ac74-2057b57c48a9 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:26.997146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1033/2075] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:26.998683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:26.999526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:27.000023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:27.016940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:27.018203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.027082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1034/2076] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:27.037477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:27.038911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.042318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453d6ddb1e2443859d9e2be9ce2001ad'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.054194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c8deb-2894-4814-b2c1-f360a2cfbc6f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:27.056999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453d6ddb1e2443859d9e2be9ce2001ad'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.060995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66854c6-714b-4e9c-be92-845fdcfe7550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:27.062237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66854c6-714b-4e9c-be92-845fdcfe7550 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:27.062536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66854c6-714b-4e9c-be92-845fdcfe7550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:27.062872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66854c6-714b-4e9c-be92-845fdcfe7550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:27.065271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453d6ddb1e2443859d9e2be9ce2001ad'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.071114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453d6ddb1e2443859d9e2be9ce2001ad'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.071114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453d6ddb1e2443859d9e2be9ce2001ad'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.077536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66854c6-714b-4e9c-be92-845fdcfe7550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:27.079077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66854c6-714b-4e9c-be92-845fdcfe7550 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:27.090422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1035/2077] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:27.152775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1043/2078] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:26 2022] DELETE /identity/v3/users/453d6ddb1e2443859d9e2be9ce2001ad => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:27.157542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:27.158066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:27.158373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:27.183105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:27.184403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.275031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1036/2079] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:27.297605 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:27.310444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.384099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b2915-2f7f-4f20-ba2c-bc6f0561eb18 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:27.396528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:27.397343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:27.397638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:27.397959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:27.442104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:27.443951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:27.460193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1044/2080] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:27.605013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:27.606478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.621498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80ee1d-947f-49c0-a6f5-928e08ea1a96 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:27.626771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:27.627695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:27.628009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:27.628317 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] PATH_INFO: `/v3/projects/0e36ee23fa3349438e619d8735e74a0d` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:27.630381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e36ee23fa3349438e619d8735e74a0d)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:27.632428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:27.634373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:27.714071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:27.715800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.718643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:27.728728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a068e-4254-42d0-bce4-1023393ac2c8 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:27.733407 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:27.734298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:27.734585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:27.735626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] PATH_INFO: `/v3/projects/82b1c37968154eb0909c16db5226cbab` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:27.737219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b1c37968154eb0909c16db5226cbab)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:27.739512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:27.791701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e36ee23fa3349438e619d8735e74a0d', 'request_id': 'req-2cbed9a3-6d78-47ea-9084-d0683ef0756e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.887352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e36ee23fa3349438e619d8735e74a0d', 'request_id': 'req-2cbed9a3-6d78-47ea-9084-d0683ef0756e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.894624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e36ee23fa3349438e619d8735e74a0d', 'request_id': 'req-2cbed9a3-6d78-47ea-9084-d0683ef0756e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.908345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] The token cache is being invalidate because project 0e36ee23fa3349438e619d8735e74a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:27.908784 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.909594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.913353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b1c37968154eb0909c16db5226cbab', 'request_id': 'req-135af07a-d44a-4883-b93d-e5ad55117b69'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.915055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1037/2081] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:27 2022] DELETE /identity/v3/projects/0e36ee23fa3349438e619d8735e74a0d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:27.916183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:27.917617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:27.921891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b1c37968154eb0909c16db5226cbab', 'request_id': 'req-135af07a-d44a-4883-b93d-e5ad55117b69'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.934742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b1c37968154eb0909c16db5226cbab', 'request_id': 'req-135af07a-d44a-4883-b93d-e5ad55117b69'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:27.997260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbed9a3-6d78-47ea-9084-d0683ef0756e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:28.040510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] The token cache is being invalidate because project 82b1c37968154eb0909c16db5226cbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:28.046188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.046995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.049054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1045/2082] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:27 2022] DELETE /identity/v3/projects/82b1c37968154eb0909c16db5226cbab => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:28.053870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:28.055610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:28.085361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:28.086446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:28.086792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:28.087130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] PATH_INFO: `/v3/users/e48ecfb0b69c42a8806bc2857b83fca3` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:28.088872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48ecfb0b69c42a8806bc2857b83fca3)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:28.091526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:28.137515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135af07a-d44a-4883-b93d-e5ad55117b69 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:28.142579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:28.143457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:28.143746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:28.144029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] PATH_INFO: `/v3/users/946833ee92134b35bcdba1598a3324dd` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:28.145376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946833ee92134b35bcdba1598a3324dd)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:28.147345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:28.309004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48ecfb0b69c42a8806bc2857b83fca3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.322590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48ecfb0b69c42a8806bc2857b83fca3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.411584 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946833ee92134b35bcdba1598a3324dd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.426617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946833ee92134b35bcdba1598a3324dd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.429536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48ecfb0b69c42a8806bc2857b83fca3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.430205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48ecfb0b69c42a8806bc2857b83fca3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.430612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:28.438083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946833ee92134b35bcdba1598a3324dd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.438978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946833ee92134b35bcdba1598a3324dd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.441736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946833ee92134b35bcdba1598a3324dd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.461675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48ecfb0b69c42a8806bc2857b83fca3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.468364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1038/2083] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:27 2022] DELETE /identity/v3/users/e48ecfb0b69c42a8806bc2857b83fca3 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:28.469414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:28.470829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:28.536388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:28.549527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c862b9-3809-4baf-8502-243ed849cdc1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:28.560002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:28.561005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:28.563101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:28.563810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] PATH_INFO: `/v3/users/521ea2680ac24d1e811a6fb7423dc371` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:28.565364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521ea2680ac24d1e811a6fb7423dc371)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:28.567533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:28.572574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1046/2084] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:28 2022] DELETE /identity/v3/users/946833ee92134b35bcdba1598a3324dd => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:28.573531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:28.574942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:28.653257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa37c9-393d-4536-afe8-4e7b1c766975 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:28.658438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:28.659200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:28.659492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:28.659770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] PATH_INFO: `/v3/projects/31e9c32c2a624957ad3a7e1e9b0356cc` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:28.661271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e9c32c2a624957ad3a7e1e9b0356cc)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:28.663862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:28.807669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521ea2680ac24d1e811a6fb7423dc371'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.817093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e9c32c2a624957ad3a7e1e9b0356cc', 'request_id': 'req-bee26046-36de-43b0-9129-ed611b9c5333'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.822329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521ea2680ac24d1e811a6fb7423dc371'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.827081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e9c32c2a624957ad3a7e1e9b0356cc', 'request_id': 'req-bee26046-36de-43b0-9129-ed611b9c5333'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.833733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e9c32c2a624957ad3a7e1e9b0356cc', 'request_id': 'req-bee26046-36de-43b0-9129-ed611b9c5333'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.892076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521ea2680ac24d1e811a6fb7423dc371'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.892916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521ea2680ac24d1e811a6fb7423dc371'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.901287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e463089c-2a19-4a0d-8a55-b87e7201f216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521ea2680ac24d1e811a6fb7423dc371'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.908109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1039/2085] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:28 2022] DELETE /identity/v3/users/521ea2680ac24d1e811a6fb7423dc371 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:28.913036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:28.913334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:28.913619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:28.931576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:28.932890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:28.974859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] The token cache is being invalidate because project 31e9c32c2a624957ad3a7e1e9b0356cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:28.975420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.980859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:28.980859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1047/2086] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:28 2022] DELETE /identity/v3/projects/31e9c32c2a624957ad3a7e1e9b0356cc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:28.982184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:28.983603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.000962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1040/2087] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:29.004761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.006527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.020074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e0536-79b8-42d3-a93f-313924495dcb None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.025213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.026312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.026856 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.029247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] PATH_INFO: `/v3/projects/450d633a4ef74ee798b34b5d69993b17` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.029247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=450d633a4ef74ee798b34b5d69993b17)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.030987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.061234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26046-36de-43b0-9129-ed611b9c5333 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.067869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.068757 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.069032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.069306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] PATH_INFO: `/v3/users/0f61fb50ab994d07bd6fb84726cf9a1a` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.070522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f61fb50ab994d07bd6fb84726cf9a1a)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.072658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.146131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450d633a4ef74ee798b34b5d69993b17', 'request_id': 'req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.218459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450d633a4ef74ee798b34b5d69993b17', 'request_id': 'req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.224643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450d633a4ef74ee798b34b5d69993b17', 'request_id': 'req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.235890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] The token cache is being invalidate because project 450d633a4ef74ee798b34b5d69993b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:29.236179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.236820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.238447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1041/2088] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:29 2022] DELETE /identity/v3/projects/450d633a4ef74ee798b34b5d69993b17 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:29.241789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.241789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.296838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab8fa3-b8f6-4010-ad69-5b04f4203e6d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.301039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.301472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.301756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.302063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.303913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.352172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:29.365280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f61fb50ab994d07bd6fb84726cf9a1a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.367065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.368532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.377478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f61fb50ab994d07bd6fb84726cf9a1a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.385781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1042/2089] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:29.386876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.388483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f61fb50ab994d07bd6fb84726cf9a1a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.388609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.388896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f61fb50ab994d07bd6fb84726cf9a1a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.389555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d65fc446-097a-4097-85aa-f17710755173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f61fb50ab994d07bd6fb84726cf9a1a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.401162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceb41a-f6bf-4974-88cf-81c774f8b17d service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.406964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.407846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.408135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.408417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] PATH_INFO: `/v3/projects/f2971ce05be042d3aeb6fd0335e9dc16` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.409647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2971ce05be042d3aeb6fd0335e9dc16)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.411689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.455220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1048/2090] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:28 2022] DELETE /identity/v3/users/0f61fb50ab994d07bd6fb84726cf9a1a => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:29.465923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1299ea1-2e03-4f7a-857b-51dfdd5b32b3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.466621 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1299ea1-2e03-4f7a-857b-51dfdd5b32b3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.467017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1299ea1-2e03-4f7a-857b-51dfdd5b32b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.478717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:29.487779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f1299ea1-2e03-4f7a-857b-51dfdd5b32b3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:29.490484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f1299ea1-2e03-4f7a-857b-51dfdd5b32b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.513625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2971ce05be042d3aeb6fd0335e9dc16', 'request_id': 'req-23239677-c7b0-44c0-9863-1146f5055b03'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.561959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1049/2091] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:29.570296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.570583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.570861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.591436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:29.594317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.614752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2971ce05be042d3aeb6fd0335e9dc16', 'request_id': 'req-23239677-c7b0-44c0-9863-1146f5055b03'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.622751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2971ce05be042d3aeb6fd0335e9dc16', 'request_id': 'req-23239677-c7b0-44c0-9863-1146f5055b03'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.637117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] The token cache is being invalidate because project f2971ce05be042d3aeb6fd0335e9dc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:29.637117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.637117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-23239677-c7b0-44c0-9863-1146f5055b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:29.638796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1043/2092] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:29 2022] DELETE /identity/v3/projects/f2971ce05be042d3aeb6fd0335e9dc16 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:29.645460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f41c-21f7-409a-9686-0d9b0d421b0f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.646639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f41c-21f7-409a-9686-0d9b0d421b0f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.647006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990f41c-21f7-409a-9686-0d9b0d421b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.667855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5990f41c-21f7-409a-9686-0d9b0d421b0f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:29.669321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5990f41c-21f7-409a-9686-0d9b0d421b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.686309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1050/2093] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:29.690543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.717631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91eb3b-f869-4f45-8620-923f4268c361 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.729781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.730493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.730783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.731066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.735026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:29.735198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.736881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.755346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1044/2094] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:29.763538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.764534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.765011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.778024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1051/2095] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:24:29.787721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.807921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20aad5-c1a9-428f-b408-8aa12e500ad6 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.810081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:29.811405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:29.814244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.814780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.815180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.815371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.816796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.819321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.835538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1045/2096] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:29.841859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.852353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db661031-560e-4c80-8912-31bc3cc019c0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.861909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.862669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.863733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.864884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.865638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:29.866043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.867833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.881833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1046/2097] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:24:29.884943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:29.895424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154679bb-fc14-488d-8709-5c0d79065dbe admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:29.900614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:29.900915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:29.901185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:29.901707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:29.902475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:29.904421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:29.946938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1052/2098] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:29.950684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.022921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e2dcf-ac7f-4bee-8bb5-73ee859e32d5 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.027916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.028678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.028850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.029126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.029846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.031775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.050063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1047/2099] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:30.050063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.054530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.125910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1053/2100] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:29 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:30.125910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.127183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.128086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59110d8-a4df-440b-aefe-312cc5b99157 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.133459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.134366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.134679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.134960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] PATH_INFO: `/v3/projects/09e8db6123ba41aaacbffd660ef4b261` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.136221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e8db6123ba41aaacbffd660ef4b261)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.138265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.141287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f9597-1787-4c07-b4b4-9e04d8284e22 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.146810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.147707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.147985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.148268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] PATH_INFO: `/v3/projects/e405ac57f0414ae98c30b7a4480b6e2b` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.149540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e405ac57f0414ae98c30b7a4480b6e2b)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.151744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.322217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e8db6123ba41aaacbffd660ef4b261', 'request_id': 'req-b9bba43b-b70e-4e33-9338-1803d91ae3d3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.347519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e405ac57f0414ae98c30b7a4480b6e2b', 'request_id': 'req-23199b0e-7d89-4a2b-acad-ebea5106028d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.354613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e405ac57f0414ae98c30b7a4480b6e2b', 'request_id': 'req-23199b0e-7d89-4a2b-acad-ebea5106028d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.360270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e405ac57f0414ae98c30b7a4480b6e2b', 'request_id': 'req-23199b0e-7d89-4a2b-acad-ebea5106028d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.423978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e8db6123ba41aaacbffd660ef4b261', 'request_id': 'req-b9bba43b-b70e-4e33-9338-1803d91ae3d3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.430527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e8db6123ba41aaacbffd660ef4b261', 'request_id': 'req-b9bba43b-b70e-4e33-9338-1803d91ae3d3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.442258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] The token cache is being invalidate because project 09e8db6123ba41aaacbffd660ef4b261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:30.442553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.443207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.444773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1048/2101] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:30 2022] DELETE /identity/v3/projects/09e8db6123ba41aaacbffd660ef4b261 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:30.446265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.447577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.509237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bba43b-b70e-4e33-9338-1803d91ae3d3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.533191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] The token cache is being invalidate because project e405ac57f0414ae98c30b7a4480b6e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:30.533682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.534129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.535793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1054/2102] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:30 2022] DELETE /identity/v3/projects/e405ac57f0414ae98c30b7a4480b6e2b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:30.536737 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.538039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.581778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80eb86-dd18-4760-ab3d-4253060c2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.582811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80eb86-dd18-4760-ab3d-4253060c2a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.583301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80eb86-dd18-4760-ab3d-4253060c2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.583729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80eb86-dd18-4760-ab3d-4253060c2a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.584619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80eb86-dd18-4760-ab3d-4253060c2a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.586779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80eb86-dd18-4760-ab3d-4253060c2a6a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.608340 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:30.608511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199b0e-7d89-4a2b-acad-ebea5106028d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.614570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.615239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.615529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.616240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.616543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.618285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.629938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1055/2103] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:30.630567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.632534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.646236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785dd40-5ad0-4535-a9d8-fe75fa58a9ba admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.651273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.652440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.652733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.653016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] PATH_INFO: `/v3/users/74db505475a94361840c94c5e4f81eee` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.654272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] RBAC: Authorizing `identity:delete_user(user_id=74db505475a94361840c94c5e4f81eee)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.656232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.660538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1049/2104] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:30 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:30.662049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.662341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.662618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.680940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:30.682180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.690164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1050/2105] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:30.691694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.701209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d332-dc93-460e-92ae-174d24217e0c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.709148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.710402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.710402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.710402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.711114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.712890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.723392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1051/2106] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:30.724217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.726118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.738593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52cb689-9ae9-4ddb-ba28-a2e1f312afaa admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.743360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615a9ac-0201-4e46-995f-3028aa8d0edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.744012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a9ac-0201-4e46-995f-3028aa8d0edd admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.744296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a9ac-0201-4e46-995f-3028aa8d0edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.744577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615a9ac-0201-4e46-995f-3028aa8d0edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.745303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a9ac-0201-4e46-995f-3028aa8d0edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.746919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615a9ac-0201-4e46-995f-3028aa8d0edd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.760395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1052/2107] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:30.760395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9885-7f37-476f-a616-484707e7014e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.760395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9885-7f37-476f-a616-484707e7014e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.760395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d9885-7f37-476f-a616-484707e7014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.778926 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-208d9885-7f37-476f-a616-484707e7014e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:30.780160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-208d9885-7f37-476f-a616-484707e7014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.788591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1053/2108] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:30.789380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9885-7f37-476f-a616-484707e7014e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.798823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d9885-7f37-476f-a616-484707e7014e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.803552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.804426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.804710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.804986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] PATH_INFO: `/v3/projects/28c58e5ce2644fa894e767d5afe848a2/users/762367b9cd0c42e38dacfa864367b7d1/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.819663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c58e5ce2644fa894e767d5afe848a2, user_id=762367b9cd0c42e38dacfa864367b7d1, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.822521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:30.889679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74db505475a94361840c94c5e4f81eee'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.902236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74db505475a94361840c94c5e4f81eee'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.909961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1054/2109] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:30 2022] PUT /identity/v3/projects/28c58e5ce2644fa894e767d5afe848a2/users/762367b9cd0c42e38dacfa864367b7d1/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:30.910189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74db505475a94361840c94c5e4f81eee'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.910759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74db505475a94361840c94c5e4f81eee'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.911001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:30.911397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-22cbdcca-7603-467c-a483-73f8d6b4567b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74db505475a94361840c94c5e4f81eee'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:30.921073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:30.987020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf06e5d-133f-477e-934d-3edac97e4365 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:30.992465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:30.993131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:30.993461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:30.993742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:30.994512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:30.996107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.006804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1055/2110] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:31.007632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.010134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.023452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36848f86-a80c-425b-b27a-7eb303e597bf admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.024713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1056/2111] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:30 2022] DELETE /identity/v3/users/74db505475a94361840c94c5e4f81eee => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:31.028033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.028033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.028033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.058543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] MFA Rules not processed for user `762367b9cd0c42e38dacfa864367b7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:31.060079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.066986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:31.090295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.090971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.091259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.091539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.092345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:31.092760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.094681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.111396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1056/2112] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:31.112632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.128088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b98d0-2b52-4d83-8236-bc005e9c2578 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.135351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.137284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.138248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.139531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1057/2113] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:31.140426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.146018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] PATH_INFO: `/v3/projects/a9a823e0c1c444f09aee8b44006d91eb/users/3df1fe535fb64877af8e6025fd19d5e0/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.154408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b22da-4b9b-4f15-8522-083ba5a11bde None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.161603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf16dd-3eae-416f-b310-38d88f69e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.162502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf16dd-3eae-416f-b310-38d88f69e542 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.163003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf16dd-3eae-416f-b310-38d88f69e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.163198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf16dd-3eae-416f-b310-38d88f69e542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.163901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf16dd-3eae-416f-b310-38d88f69e542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.165283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a823e0c1c444f09aee8b44006d91eb, user_id=3df1fe535fb64877af8e6025fd19d5e0, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.165936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf16dd-3eae-416f-b310-38d88f69e542 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.168082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.242359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1057/2114] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:31 2022] PUT /identity/v3/projects/a9a823e0c1c444f09aee8b44006d91eb/users/3df1fe535fb64877af8e6025fd19d5e0/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:31.243442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.245064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.308906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9522-c03a-436e-9ef1-17a182591080 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.313696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1058/2115] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:31 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:31.315268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.315559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.315842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.318208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.319099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.319548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.320050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.337117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:31.338542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.395497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.396986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.407524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1058/2116] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:31.408450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.416861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1059/2117] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:31.427379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.428850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.493560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293154c-fdbc-4b2a-af77-afa193b8846d service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.512370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.512370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.512370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.512370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.512799 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.512799 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.515245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f475b-403f-40b3-893a-f0abb4e5a419 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.520110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.520869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.521158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.521444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.536447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.540402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.548053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1060/2118] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:24:31.548962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.550357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.563403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d73f3-e9ee-417d-b5c6-c8e1c0089db7 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.569032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.570074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.570360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.570640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] PATH_INFO: `/v3/users/762367b9cd0c42e38dacfa864367b7d1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.571865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=762367b9cd0c42e38dacfa864367b7d1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.574285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.583215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1059/2119] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:31 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:31.584222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.587229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.601114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed441f0-881d-4208-b44f-153237dacff2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.606526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.607408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.607687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.607961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] PATH_INFO: `/v3/projects/7b424d0dde9343ddaa283666c3190f4e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.609140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b424d0dde9343ddaa283666c3190f4e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.611064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.774549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762367b9cd0c42e38dacfa864367b7d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.777473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b424d0dde9343ddaa283666c3190f4e', 'request_id': 'req-5bb2fae4-cd7e-4954-9152-4e620f82fa94'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.786467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762367b9cd0c42e38dacfa864367b7d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.793156 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762367b9cd0c42e38dacfa864367b7d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.794107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762367b9cd0c42e38dacfa864367b7d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.794877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762367b9cd0c42e38dacfa864367b7d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.866137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b424d0dde9343ddaa283666c3190f4e', 'request_id': 'req-5bb2fae4-cd7e-4954-9152-4e620f82fa94'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.873482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b424d0dde9343ddaa283666c3190f4e', 'request_id': 'req-5bb2fae4-cd7e-4954-9152-4e620f82fa94'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.890381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] The token cache is being invalidate because project 7b424d0dde9343ddaa283666c3190f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:31.890813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.891541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:31.893897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1060/2120] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:31 2022] DELETE /identity/v3/projects/7b424d0dde9343ddaa283666c3190f4e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:31.897167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.897167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:31.963897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2fae4-cd7e-4954-9152-4e620f82fa94 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:31.968661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d53f15-b123-4aca-bc49-7b8b5a49b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:31.969323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d53f15-b123-4aca-bc49-7b8b5a49b5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.969608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d53f15-b123-4aca-bc49-7b8b5a49b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.969942 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d53f15-b123-4aca-bc49-7b8b5a49b5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.970671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d53f15-b123-4aca-bc49-7b8b5a49b5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:31.972394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d53f15-b123-4aca-bc49-7b8b5a49b5e3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:31.982397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1061/2121] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:31.983662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477016-face-4557-981d-7da17a8e8649 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:31.983954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477016-face-4557-981d-7da17a8e8649 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:31.984289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477016-face-4557-981d-7da17a8e8649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:31.985907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1061/2122] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:31 2022] DELETE /identity/v3/users/762367b9cd0c42e38dacfa864367b7d1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:31.986740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:31.990366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.003024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d4477016-face-4557-981d-7da17a8e8649 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:32.004901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d4477016-face-4557-981d-7da17a8e8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.067080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1062/2123] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:32.068642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.069088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.069570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.070403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1bad7-f10f-4815-9036-9fa0860077fa admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.090556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809f27-f59a-4e4c-aea2-32c64416ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.091456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809f27-f59a-4e4c-aea2-32c64416ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.091847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809f27-f59a-4e4c-aea2-32c64416ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.092234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809f27-f59a-4e4c-aea2-32c64416ba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.093469 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b809f27-f59a-4e4c-aea2-32c64416ba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.095213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b809f27-f59a-4e4c-aea2-32c64416ba9e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.097778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:32.099061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.109834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1062/2124] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:32.109834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.109834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.109834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.111823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1063/2125] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:32.114534 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.126656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6bd1d-e31e-401b-9c04-3ee979d68323 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.132361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.133864 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.134155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.134430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] PATH_INFO: `/v3/projects/b77cc280f9434fb0baa46197f1d4f325/users/e9697020fbab476ca1c2132173f59eb7/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.135243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:32.136633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.149400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1063/2126] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:32.149400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.152761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.153345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b77cc280f9434fb0baa46197f1d4f325, user_id=e9697020fbab476ca1c2132173f59eb7, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.157336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.215321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7b5e0-6395-462e-8967-fd6d66546e2c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.219088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.221436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.221436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.221436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.230215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.231662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.241245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1064/2127] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:32.242061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.251085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55965f56-2c67-431d-9f56-ff41eb9b5a79 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.256377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.257018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.257300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.257579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.258349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:32.258660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.260299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc2f31-7cdd-4be3-ba5c-20a5cd6efde1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.267726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1064/2128] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:32 2022] PUT /identity/v3/projects/b77cc280f9434fb0baa46197f1d4f325/users/e9697020fbab476ca1c2132173f59eb7/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:32.276055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1065/2129] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:32.277691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.281947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.282324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.282681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.311678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] MFA Rules not processed for user `e9697020fbab476ca1c2132173f59eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:32.313011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.344755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68903b-26b8-4bea-b9e7-e246d6f1d454 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.350665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.351350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.351618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.351900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.352929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.354592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.386928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1066/2130] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:32.391394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.402978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394efe-8dda-4fb5-b2e0-4674a23b0072 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.408164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.408824 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.409110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.409381 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.410390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.412319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.448623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1065/2131] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:32.449892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.465689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:32.516686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1067/2132] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:32.516875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0733-1b84-4242-b5ad-8d568cb620f9 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.518719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.579672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.580656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.580656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.581054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.582482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.584538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.593019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d004e9a-c2d1-43bd-8cb8-75f92b66a093 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.595660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:32.600555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.601327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.601614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.601925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.602647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.604748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.682579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1066/2133] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:32.684692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.697785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a911c2-89f2-4052-bcf0-29cc5b2f30ad admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.704182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.704794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.705590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.705590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.706773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.709031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.721620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1068/2134] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:32 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:24:32.721793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1067/2135] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:32.725253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.725640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.738730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9306-b887-46e1-84a7-4654ba726a3a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.741839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84870f69-4fb9-477d-bf87-81e570686b10 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.745648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.746765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.747067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.749921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.749921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.750116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.750565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.751423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.752075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.752558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.754207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.756161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.769624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1069/2136] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:32.773443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.776309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1068/2137] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:32.782399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.785085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebd4d4-08b5-4bee-91a7-7094416f7dd4 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.790366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.791633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.791982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.792329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] PATH_INFO: `/v3/projects/573ce6e647824f25b590234c10d0adeb/users/a7d26b4af21040819c0a1a4bdf803f5a/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.793505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d581b-9ac4-4285-8c5b-c8eae6bc2ae1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:32.801945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:32.807423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:32.807423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:32.807423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] PATH_INFO: `/v3/projects/7b73ad03d1394008b736632c801e95f1/users/304d91c3bc3f472391fd05e833f5b4d5/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:32.810495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573ce6e647824f25b590234c10d0adeb, user_id=a7d26b4af21040819c0a1a4bdf803f5a, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.813511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.820266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b73ad03d1394008b736632c801e95f1, user_id=304d91c3bc3f472391fd05e833f5b4d5, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:32.822941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:32.905504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1070/2138] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:32 2022] PUT /identity/v3/projects/573ce6e647824f25b590234c10d0adeb/users/a7d26b4af21040819c0a1a4bdf803f5a/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:32.908849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.911341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:32.931660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1069/2139] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:32 2022] PUT /identity/v3/projects/7b73ad03d1394008b736632c801e95f1/users/304d91c3bc3f472391fd05e833f5b4d5/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:32.936203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:32.997994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6ea67-6736-4401-9731-01531c8cf646 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.013388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fe0b5-a492-4f2a-9391-c83ee747c8e2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.021769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f54997-3824-4e8a-a1de-e3d60a563700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.026074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f54997-3824-4e8a-a1de-e3d60a563700 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.026721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f54997-3824-4e8a-a1de-e3d60a563700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.027114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f54997-3824-4e8a-a1de-e3d60a563700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.028015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f54997-3824-4e8a-a1de-e3d60a563700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.033665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f54997-3824-4e8a-a1de-e3d60a563700 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.043384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1070/2140] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:33.045182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cadac-9462-4684-ae43-2ef673b0ad13 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.045680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cadac-9462-4684-ae43-2ef673b0ad13 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.046337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cadac-9462-4684-ae43-2ef673b0ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.067431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.068309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.068588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.068860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] PATH_INFO: `/v3/projects/28c58e5ce2644fa894e767d5afe848a2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.070166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c58e5ce2644fa894e767d5afe848a2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.072390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.087656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ef9cadac-9462-4684-ae43-2ef673b0ad13 None None] MFA Rules not processed for user `304d91c3bc3f472391fd05e833f5b4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:33.088916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ef9cadac-9462-4684-ae43-2ef673b0ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.161035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1071/2141] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:33.162373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.162664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.162939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.188231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c58e5ce2644fa894e767d5afe848a2', 'request_id': 'req-4cb71575-0a12-40c4-8929-f768684fb23a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:33.194141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] MFA Rules not processed for user `3df1fe535fb64877af8e6025fd19d5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:33.195424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.196112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c58e5ce2644fa894e767d5afe848a2', 'request_id': 'req-4cb71575-0a12-40c4-8929-f768684fb23a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:33.201948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c58e5ce2644fa894e767d5afe848a2', 'request_id': 'req-4cb71575-0a12-40c4-8929-f768684fb23a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:33.262147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1072/2142] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:33.262894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.322346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] The token cache is being invalidate because project 28c58e5ce2644fa894e767d5afe848a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:33.322640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:33.323296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:33.324518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757f8f0-7cd9-484b-b3a8-ed87e1881aa5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.324874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1071/2143] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:32 2022] DELETE /identity/v3/projects/28c58e5ce2644fa894e767d5afe848a2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:33.327282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.328604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.330684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.331257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.331579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.331882 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] PATH_INFO: `/v3/projects/573ce6e647824f25b590234c10d0adeb/users/a7d26b4af21040819c0a1a4bdf803f5a/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.334097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573ce6e647824f25b590234c10d0adeb, user_id=a7d26b4af21040819c0a1a4bdf803f5a, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.336760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.342946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb71575-0a12-40c4-8929-f768684fb23a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.347478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1073/2144] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:33 2022] PUT /identity/v3/projects/573ce6e647824f25b590234c10d0adeb/users/a7d26b4af21040819c0a1a4bdf803f5a/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:33.348359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.350268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.404014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd44a6-66ab-4b9b-b594-f039d809c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.404677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd44a6-66ab-4b9b-b594-f039d809c060 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.404971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd44a6-66ab-4b9b-b594-f039d809c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.405245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd44a6-66ab-4b9b-b594-f039d809c060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.405983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd44a6-66ab-4b9b-b594-f039d809c060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.407917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd44a6-66ab-4b9b-b594-f039d809c060 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.416413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0677-1c4f-4af5-aae2-f63d59669f66 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.421480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae5b58-189a-4aab-b447-aa81c2cf78f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.422189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5b58-189a-4aab-b447-aa81c2cf78f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.422471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5b58-189a-4aab-b447-aa81c2cf78f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.422746 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae5b58-189a-4aab-b447-aa81c2cf78f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.423491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5b58-189a-4aab-b447-aa81c2cf78f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.425907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae5b58-189a-4aab-b447-aa81c2cf78f5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.497830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1072/2145] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:33.497830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.497830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.497830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.519061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:33.519061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.519539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:33.528868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1074/2146] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:33.528868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.528868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.528868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.555516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] MFA Rules not processed for user `a7d26b4af21040819c0a1a4bdf803f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:33.556743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.577079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1073/2147] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:33.578019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.587604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bede0-f7dc-44db-857d-257e6d6ab384 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.596978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:33.626195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1075/2148] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:33.627018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.648209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3afdf8-41d5-4945-acf2-3fb4d24fe12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.648885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3afdf8-41d5-4945-acf2-3fb4d24fe12b admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.649171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3afdf8-41d5-4945-acf2-3fb4d24fe12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.649451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3afdf8-41d5-4945-acf2-3fb4d24fe12b admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.650218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3afdf8-41d5-4945-acf2-3fb4d24fe12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.652564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3afdf8-41d5-4945-acf2-3fb4d24fe12b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.691425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1942a-bb64-4fee-b3cd-db901a7cea4a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.696414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.697108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.697392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.697698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.698428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.700359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.775960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1074/2149] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:33.775960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.775960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.775960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.793926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:33.795227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.801992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1076/2150] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:33.803016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.803815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1075/2151] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:33.804613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.806488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.814614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82db274f-af36-4fb6-942d-d32163bbd84b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.820350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.821029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.821320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.821600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.822363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.824085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.834825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1076/2152] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:33.835783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.846590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d74fac-87eb-46ad-9779-a9e29e06dcbd admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.851895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.852597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.852884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.853165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.853915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.855558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.866107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1077/2153] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:33.866773 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.868775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ea222-000c-429f-b72b-04abaee74f7d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.872511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.873159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.873439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.873713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.876812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:33.877575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f5e69-c463-44df-81ca-6c1531721045 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.883202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.883853 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.884141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.884421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.885151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:33.885462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.887164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.899975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1078/2154] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:33.900979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.911499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b909-482c-47a8-990f-1b03b315d39d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.916815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.917690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.918007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.918289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] PATH_INFO: `/v3/projects/843266f329d04344b4c6fe58a60640ad/users/ddc1f4745e4d4552822943170de5667d/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.934906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843266f329d04344b4c6fe58a60640ad, user_id=ddc1f4745e4d4552822943170de5667d, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.937641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.945224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.946715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:33.956013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1077/2155] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:33.957397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:33.968247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28397-79bd-4e74-8c7b-456d36114d4f service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:33.977676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:33.977676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:33.977676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:33.977676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] PATH_INFO: `/v3/projects/aa6e0f4f7dd24c28bc84120f95f1e173/users/ff02433a68264d639952b48d7a8a4686/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:33.993737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6e0f4f7dd24c28bc84120f95f1e173, user_id=ff02433a68264d639952b48d7a8a4686, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:33.996780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.002622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1079/2156] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:33 2022] PUT /identity/v3/projects/843266f329d04344b4c6fe58a60640ad/users/ddc1f4745e4d4552822943170de5667d/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:34.003220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.015982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:34.078991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bfb8d-b57d-4389-bc20-501219714ea5 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.086419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.087356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.087723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.088371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.088699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.091186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.096510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1078/2157] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:33 2022] PUT /identity/v3/projects/aa6e0f4f7dd24c28bc84120f95f1e173/users/ff02433a68264d639952b48d7a8a4686/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:34.096510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.096772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:34.167283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f72f6-0086-4fd2-b8eb-eebca1676bb8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.172008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.172678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.172958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.173237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.174002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.176278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.186482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1079/2158] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:34.187386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.193029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1080/2159] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:34 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:34.193719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.198804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b157bf-6e75-4b7e-ae88-61a0b702e00c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.256144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.256511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f0504-838c-4f60-a95a-21034817f3c1 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.256986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.257346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.257633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.258402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.260017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.263161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.264079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.266224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.266516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] PATH_INFO: `/v3/projects/843266f329d04344b4c6fe58a60640ad/users/ddc1f4745e4d4552822943170de5667d/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.269073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843266f329d04344b4c6fe58a60640ad, user_id=ddc1f4745e4d4552822943170de5667d, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.275131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1080/2160] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:34.275288 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.275404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.285832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad4fb2-600b-4948-a07f-efd4d799ca40 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.286502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1081/2161] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:34 2022] PUT /identity/v3/projects/843266f329d04344b4c6fe58a60640ad/users/ddc1f4745e4d4552822943170de5667d/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:34.287600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.345079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.345761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.346071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.346359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.347057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.349646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.350423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb0509-831a-453e-9b3a-2f8cca5c9779 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.355046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3931a-7250-43dd-9be7-2cdbed2784f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.355921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3931a-7250-43dd-9be7-2cdbed2784f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.356209 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3931a-7250-43dd-9be7-2cdbed2784f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.356474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3931a-7250-43dd-9be7-2cdbed2784f0 admin admin] PATH_INFO: `/v3/projects/aa6e0f4f7dd24c28bc84120f95f1e173/users/ff02433a68264d639952b48d7a8a4686/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.358475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3931a-7250-43dd-9be7-2cdbed2784f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6e0f4f7dd24c28bc84120f95f1e173, user_id=ff02433a68264d639952b48d7a8a4686, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.361164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3931a-7250-43dd-9be7-2cdbed2784f0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.375972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1082/2162] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:34 2022] PUT /identity/v3/projects/aa6e0f4f7dd24c28bc84120f95f1e173/users/ff02433a68264d639952b48d7a8a4686/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:34.377248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.377543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.377886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.407441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] MFA Rules not processed for user `ddc1f4745e4d4552822943170de5667d`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:34.408663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:34.464649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1081/2163] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:34 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:34.468743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.477166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1083/2164] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:34.479012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a02b-3aad-4ba1-ab76-3968ce2c291e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.490906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.551869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf0b7-b192-48c5-b548-76b23e938dbd None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.556521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.556947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.557231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.557528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.559437 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:34.569425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.570260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.570556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.570841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.571585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.573432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.585844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1082/2165] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:34.588513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.598911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604692f1-0ef6-40f8-81cc-30c84992657c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.604611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.605593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.606000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.606407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.607351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.609224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.620495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1083/2166] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:34.624038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.624639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.625561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00851f09-413b-419a-a192-338fcab16cb6 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.632637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:34.635563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1084/2167] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:34.636547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ba7c8-e882-4f65-942d-ea63ff3da1db admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:34.641619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:34.642792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.643103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.643385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] PATH_INFO: `/v3/projects/5a57f50c24d941e0a8466917a2928316/users/843d2e076e7c445e8b6d25f7c7554f9b/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.660078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a57f50c24d941e0a8466917a2928316, user_id=843d2e076e7c445e8b6d25f7c7554f9b, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:34.663034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:34.788613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1084/2168] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:34 2022] PUT /identity/v3/projects/5a57f50c24d941e0a8466917a2928316/users/843d2e076e7c445e8b6d25f7c7554f9b/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:24:34.798693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575708ef-a6b2-4176-8d1b-f01b63c55da1 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:34.798987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575708ef-a6b2-4176-8d1b-f01b63c55da1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:34.799272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575708ef-a6b2-4176-8d1b-f01b63c55da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:34.827730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-575708ef-a6b2-4176-8d1b-f01b63c55da1 None None] MFA Rules not processed for user `843d2e076e7c445e8b6d25f7c7554f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:34.829010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-575708ef-a6b2-4176-8d1b-f01b63c55da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:34.902460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:34.924095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1085/2169] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:34.936918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:34.939138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:35.029150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618745a2-5b79-427d-8589-fb826ed5fa96 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:35.033841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:35.034507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:35.034859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:35.035240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:35.043884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:35.045549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:35.056242 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1085/2170] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:35.303470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac0eb-de0c-49bb-98b4-429d825bfb3d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:35.304174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac0eb-de0c-49bb-98b4-429d825bfb3d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:35.304634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bac0eb-de0c-49bb-98b4-429d825bfb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:35.326256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e2bac0eb-de0c-49bb-98b4-429d825bfb3d None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:35.327447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e2bac0eb-de0c-49bb-98b4-429d825bfb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:35.393609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1086/2171] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:35.455262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:35.458660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:35.556352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c5605-39f8-44dc-9ac1-0d6d22dd3242 service glance] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:35.561678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:35.562379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:35.562669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:35.562948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:35.572199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:35.573918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:35.583201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1086/2172] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:24:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:24:35.892965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:35.893690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:35.894999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:35.951087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:35.959198 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] MFA Rules not processed for user `ff02433a68264d639952b48d7a8a4686`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:35.962599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:36.112450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1087/2173] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:24:36.167960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:36.170371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:36.175979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:36.293114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55e49f-bf46-413e-b2b6-dbd21101438b service swift] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:36.297680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:36.298786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:36.299179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:36.299536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:36.302725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:36.383707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:36.383707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:36.403350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1087/2174] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:37.763510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:37.932521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:38.523612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:38.844114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:38.855076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e0fe4-9009-490b-9a1d-22d07726450d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:38.859065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:38.859642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:38.859939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:38.860222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:38.871952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:38.873601 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:38.886645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1088/2175] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:38.974963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:39.430481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:39.574526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:39.865011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:39.887955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.008088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.036776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.065233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.151200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.208570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.356566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.408097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:40.522207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:42.214075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:42.223924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e86d-81f3-41f0-8bd0-d537f067b5ef service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:42.231267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:42.231267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:42.231267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:42.231267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:42.307867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:42.309791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:42.327083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1088/2176] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:42.632798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:42.648076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274d6f0-c172-47fe-acb6-de5a0adf3d6b service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:42.656990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661cd6-92d1-41ed-9165-6c3d9409d83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:42.664138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661cd6-92d1-41ed-9165-6c3d9409d83d service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:42.664708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661cd6-92d1-41ed-9165-6c3d9409d83d service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:42.665399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661cd6-92d1-41ed-9165-6c3d9409d83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:42.798315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661cd6-92d1-41ed-9165-6c3d9409d83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:42.799922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661cd6-92d1-41ed-9165-6c3d9409d83d service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:42.833210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1089/2177] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:51.984700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:51.986213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:52.082862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9be15-ad13-4fa4-b9e5-edf4ab210b4d service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:52.088974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:52.090045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:52.090335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:52.090617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] PATH_INFO: `/v3/users/e9697020fbab476ca1c2132173f59eb7` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:52.091878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9697020fbab476ca1c2132173f59eb7)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:52.093934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:52.370789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:52.372618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9697020fbab476ca1c2132173f59eb7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:52.386228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9697020fbab476ca1c2132173f59eb7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:52.468721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9697020fbab476ca1c2132173f59eb7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:52.469300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9697020fbab476ca1c2132173f59eb7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:52.476564 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9697020fbab476ca1c2132173f59eb7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:52.482751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1089/2178] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:51 2022] DELETE /identity/v3/users/e9697020fbab476ca1c2132173f59eb7 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:52.487240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:52.487768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:52.487887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:52.505532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:52.506791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:52.572062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1090/2179] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:52.581158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:52.582576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:52.657935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e30f58-f57e-490d-ba0a-33d1e8249c70 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:52.661813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:52.662570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:52.662927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:52.663224 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:52.673222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:52.674733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:52.685467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1090/2180] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:24:53.106432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:53.109037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:53.141727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236908-8068-4946-89f8-9c426bc8ecf0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:53.149494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:53.150743 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:53.153067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:53.153067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] PATH_INFO: `/v3/projects/b77cc280f9434fb0baa46197f1d4f325` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:53.153963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b77cc280f9434fb0baa46197f1d4f325)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:53.156291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:53.303220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:53.307643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b77cc280f9434fb0baa46197f1d4f325', 'request_id': 'req-efafcd2f-016f-4b1f-b967-2df18159f69a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.316162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b77cc280f9434fb0baa46197f1d4f325', 'request_id': 'req-efafcd2f-016f-4b1f-b967-2df18159f69a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.338648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b77cc280f9434fb0baa46197f1d4f325', 'request_id': 'req-efafcd2f-016f-4b1f-b967-2df18159f69a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.442796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] The token cache is being invalidate because project b77cc280f9434fb0baa46197f1d4f325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:53.443121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.443741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.445571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1091/2181] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:53 2022] DELETE /identity/v3/projects/b77cc280f9434fb0baa46197f1d4f325 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:53.449631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:53.459515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd85d-2a5b-40b8-bde1-4d068ae3dc57 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:53.521674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:53.522592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:53.522880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:53.523246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] PATH_INFO: `/v3/users/a7d26b4af21040819c0a1a4bdf803f5a` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:53.525520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d26b4af21040819c0a1a4bdf803f5a)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:53.526935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:53.740874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d26b4af21040819c0a1a4bdf803f5a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.752595 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d26b4af21040819c0a1a4bdf803f5a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.755128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:53.846469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d26b4af21040819c0a1a4bdf803f5a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.847104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d26b4af21040819c0a1a4bdf803f5a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.855020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-54ec987e-fbb1-481e-a27a-16622a32fc0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d26b4af21040819c0a1a4bdf803f5a'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:53.861137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1091/2182] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:24:53 2022] DELETE /identity/v3/users/a7d26b4af21040819c0a1a4bdf803f5a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:54.341083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:54.343033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:54.358082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafcd2f-016f-4b1f-b967-2df18159f69a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:54.415881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:54.416754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:54.417043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:54.417320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] PATH_INFO: `/v3/projects/573ce6e647824f25b590234c10d0adeb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:54.418521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=573ce6e647824f25b590234c10d0adeb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:54.420449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:54.522105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573ce6e647824f25b590234c10d0adeb', 'request_id': 'req-68476a1f-764a-4ced-8ec5-e65c8801aa9b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:54.528807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573ce6e647824f25b590234c10d0adeb', 'request_id': 'req-68476a1f-764a-4ced-8ec5-e65c8801aa9b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:54.534202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573ce6e647824f25b590234c10d0adeb', 'request_id': 'req-68476a1f-764a-4ced-8ec5-e65c8801aa9b'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:54.599630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] The token cache is being invalidate because project 573ce6e647824f25b590234c10d0adeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:24:54.599851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:54.600763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-68476a1f-764a-4ced-8ec5-e65c8801aa9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:24:54.602615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1092/2183] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:24:54 2022] DELETE /identity/v3/projects/573ce6e647824f25b590234c10d0adeb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:54.608923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:54.609395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:54.619051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:54.632268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:54.634193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:54.702735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1092/2184] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:54.711181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:54.711887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:54.712499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:54.733874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:54.735241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:54.745516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1093/2185] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:54.750047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:54.760915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db721571-fa61-419c-b38d-e171fee2e696 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:54.765727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:54.766411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:54.769083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:54.769083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:54.769083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:24:54.769083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:54.769734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:54.781998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1093/2186] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:24:54.786953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:54.797532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db3f14-9866-4559-82db-27f7cf7ae197 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:54.805790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:54.806512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:54.806801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:54.807084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:54.807804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:54.809840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:54.940082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1094/2187] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:24:54 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:54.944176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:54.955428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84f492-1de7-4a9b-95b4-e7de3af5ec13 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:55.015259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:55.016209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:55.016494 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:55.016777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:55.017492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:55.019487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:55.126065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1094/2188] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:24:54 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:24:55.130159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:55.141570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7763ab-b628-4492-92f3-7f977884d6e3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:55.147144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:55.148152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:55.149282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:55.149857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:55.150766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:55.152904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:55.165327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1095/2189] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:24:55.169472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:55.180514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2ba63-b65e-4317-ae86-b77d5eb288c0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:55.187744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c949a4-33b1-4233-8142-afc6ba40421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:55.192342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c949a4-33b1-4233-8142-afc6ba40421e admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:55.192342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c949a4-33b1-4233-8142-afc6ba40421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:55.192342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c949a4-33b1-4233-8142-afc6ba40421e admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:55.192342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c949a4-33b1-4233-8142-afc6ba40421e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:55.192342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c949a4-33b1-4233-8142-afc6ba40421e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:55.204422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1095/2190] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:24:55.208415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:55.220507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efe825-4404-4dc4-a4c7-dea6a70738db admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:55.227652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:55.229475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:55.230041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:55.230447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] PATH_INFO: `/v3/projects/ae372a6537684625acb82b36862bde25/users/85d4be423d794100ac5b00d32fb5620c/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:55.255412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae372a6537684625acb82b36862bde25, user_id=85d4be423d794100ac5b00d32fb5620c, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:55.261899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:55.379748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1096/2191] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:24:55 2022] PUT /identity/v3/projects/ae372a6537684625acb82b36862bde25/users/85d4be423d794100ac5b00d32fb5620c/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:24:55.386248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7b9f-ecbc-45cb-8a55-3f3ab8d7e1f6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:55.386752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7b9f-ecbc-45cb-8a55-3f3ab8d7e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:55.387083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7b9f-ecbc-45cb-8a55-3f3ab8d7e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:55.413684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ffef7b9f-ecbc-45cb-8a55-3f3ab8d7e1f6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:24:55.415189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ffef7b9f-ecbc-45cb-8a55-3f3ab8d7e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:55.471909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:55.489445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1096/2192] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:24:55.500159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:24:55.501867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:24:55.507269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:24:55.568265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac1ca6-713a-4065-9ac2-91d2b2c740d4 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:24:55.574480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:24:55.575236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:24:55.575622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:24:55.575973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:24:55.587754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:24:55.589213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:24:55.599017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1097/2193] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:03.741356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:03.742479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:03.742624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:03.790750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] MFA Rules not processed for user `85d4be423d794100ac5b00d32fb5620c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:03.792345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:03.947360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1097/2194] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:03.952871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:03.966256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ff3e2-cf45-4d71-8ac0-575d56c27288 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:03.980063 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:03.981159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:03.982147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:03.982871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:03.984118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:03.988998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:04.130247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1098/2195] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:03 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:25:04.135787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:04.158834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670641b-4d65-476b-8bd6-3d6d757e0431 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:04.339236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:04.340370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:04.341033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:04.341877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:04.343302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:04.353062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:04.485115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1098/2196] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:04 2022] POST /identity/v3/users => generated 291 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:04.489262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:04.501465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac719-4272-4bca-be8f-fbf11b5c12c6 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:04.507192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:04.507192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:04.507393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:04.508304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:04.509010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:04.510687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:04.523611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1099/2197] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:25:04.527990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:04.540807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3963715-c595-4210-9459-a2b05d9313d8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:04.546219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:04.547557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:04.547847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:04.548136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] PATH_INFO: `/v3/projects/07483bf3b747478d8310ea34de228630/users/bc51d114c672470291af52ff627887f4/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:04.568047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07483bf3b747478d8310ea34de228630, user_id=bc51d114c672470291af52ff627887f4, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:04.571625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:04.678049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1099/2198] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:04 2022] PUT /identity/v3/projects/07483bf3b747478d8310ea34de228630/users/bc51d114c672470291af52ff627887f4/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:25:04.682412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:04.695470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31364f02-4393-4d1c-a837-e49c2265bcf4 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:04.807667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:04.808371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:04.808725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:04.809155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:04.809764 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:04.811577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:04.823947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1100/2199] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:04.827836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:04.845483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00f1cd-89d7-40b8-8467-80869bd5f6f0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:04.850901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:04.852541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:04.852903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:04.853265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] PATH_INFO: `/v3/projects/07483bf3b747478d8310ea34de228630/users/bc51d114c672470291af52ff627887f4/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:04.856011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07483bf3b747478d8310ea34de228630, user_id=bc51d114c672470291af52ff627887f4, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:04.858714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:04.870531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1100/2200] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:04 2022] PUT /identity/v3/projects/07483bf3b747478d8310ea34de228630/users/bc51d114c672470291af52ff627887f4/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:25:08.509660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:08.511593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:08.554744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1308250-f898-4a6d-99f9-cf8d361f2258 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:08.809716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:08.810673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:08.810957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:08.811231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] PATH_INFO: `/v3/users/3df1fe535fb64877af8e6025fd19d5e0` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:08.816254 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df1fe535fb64877af8e6025fd19d5e0)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:08.822296 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:08.886074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:09.135292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df1fe535fb64877af8e6025fd19d5e0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:09.179058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df1fe535fb64877af8e6025fd19d5e0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:09.194187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df1fe535fb64877af8e6025fd19d5e0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:09.196600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df1fe535fb64877af8e6025fd19d5e0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:09.197630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df1fe535fb64877af8e6025fd19d5e0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:09.297749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1101/2201] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:08 2022] DELETE /identity/v3/users/3df1fe535fb64877af8e6025fd19d5e0 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:09.916661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:09.924017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:09.969589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a96d8-9250-49b8-b50c-80180f510295 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:10.031064 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:10.127233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:10.128489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:10.128943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:10.129718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] PATH_INFO: `/v3/projects/a9a823e0c1c444f09aee8b44006d91eb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:10.131158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a823e0c1c444f09aee8b44006d91eb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:10.135932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:10.296039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a823e0c1c444f09aee8b44006d91eb', 'request_id': 'req-edfd8bcb-2a06-4e85-9256-72d9b1714262'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:10.405245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a823e0c1c444f09aee8b44006d91eb', 'request_id': 'req-edfd8bcb-2a06-4e85-9256-72d9b1714262'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:10.412733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a823e0c1c444f09aee8b44006d91eb', 'request_id': 'req-edfd8bcb-2a06-4e85-9256-72d9b1714262'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:10.453018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] The token cache is being invalidate because project a9a823e0c1c444f09aee8b44006d91eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:10.453605 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:10.454476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:10.456235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1101/2202] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:09 2022] DELETE /identity/v3/projects/a9a823e0c1c444f09aee8b44006d91eb => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:10.460980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:10.482703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9916f-5356-4ca9-9966-5b1fbb47980a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:10.700003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:10.701152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:10.701152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:10.701583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] PATH_INFO: `/v3/users/ff02433a68264d639952b48d7a8a4686` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:10.705446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff02433a68264d639952b48d7a8a4686)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:10.707490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:11.009221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff02433a68264d639952b48d7a8a4686'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:11.045882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff02433a68264d639952b48d7a8a4686'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:11.070412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff02433a68264d639952b48d7a8a4686'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:11.073928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff02433a68264d639952b48d7a8a4686'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:11.077972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cf9a09aa-6e4d-4b2b-8cf4-5708ab712fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff02433a68264d639952b48d7a8a4686'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:11.168586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1102/2203] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:10 2022] DELETE /identity/v3/users/ff02433a68264d639952b48d7a8a4686 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:11.683542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:11.687005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:11.716484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd8bcb-2a06-4e85-9256-72d9b1714262 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:11.813696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:11.814756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:11.815146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:11.815578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] PATH_INFO: `/v3/projects/aa6e0f4f7dd24c28bc84120f95f1e173` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:11.829431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6e0f4f7dd24c28bc84120f95f1e173)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:11.835183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:11.969596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6e0f4f7dd24c28bc84120f95f1e173', 'request_id': 'req-05596d30-3cac-4644-bc3a-3003ce515814'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:12.084369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6e0f4f7dd24c28bc84120f95f1e173', 'request_id': 'req-05596d30-3cac-4644-bc3a-3003ce515814'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:12.096699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6e0f4f7dd24c28bc84120f95f1e173', 'request_id': 'req-05596d30-3cac-4644-bc3a-3003ce515814'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:12.099689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:12.136105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] The token cache is being invalidate because project aa6e0f4f7dd24c28bc84120f95f1e173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:12.136479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:12.137442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-05596d30-3cac-4644-bc3a-3003ce515814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:12.141057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1102/2204] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:11 2022] DELETE /identity/v3/projects/aa6e0f4f7dd24c28bc84120f95f1e173 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:12.148926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:12.154666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:12.154666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:12.166472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:12.174533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:12.177840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:12.303805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:12.305077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:12.305432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:12.310269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1103/2205] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:12.348060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:12.350093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:12.362695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1103/2206] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:12.367912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:12.391992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eede28e-736d-47b4-8261-4f836903b316 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:12.405062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:12.407342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:12.408761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:12.409309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:12.411050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:25:12.412304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:12.416284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:12.451286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1104/2207] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:25:12.455970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:12.469396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecadb2-2bca-4967-a2e4-14f9526dfef6 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:12.484116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:12.484805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:12.485092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:12.485368 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:12.486139 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:12.488063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:12.605002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:12.614751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1104/2208] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:12 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:12.621133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7c16c-f3bb-4717-bc4f-e9f941bf9a42 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:12.778917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:12.779945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:12.779945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:12.780179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:12.781194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:12.783304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:12.922435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1105/2209] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:12 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:12.925596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:12.939761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9027b7-e1ee-40ef-9148-375a333db44a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:13.053710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:13.060090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:13.060090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:13.060090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:13.067722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:13.071446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:13.126560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1105/2210] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:13.130675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:13.272306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16708b-6388-41fd-94e1-1b30dd08e9fc admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:13.285290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dac61e-e8d3-453f-b1af-b8e1a48cf093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:13.286558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac61e-e8d3-453f-b1af-b8e1a48cf093 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:13.286850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac61e-e8d3-453f-b1af-b8e1a48cf093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:13.287132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dac61e-e8d3-453f-b1af-b8e1a48cf093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:13.290394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dac61e-e8d3-453f-b1af-b8e1a48cf093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:13.296376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dac61e-e8d3-453f-b1af-b8e1a48cf093 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:13.322186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1106/2211] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:13.326425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:13.343493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759817b-3b21-4c2d-8949-fcca3dcba383 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:13.355037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:13.356653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:13.357105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:13.357544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] PATH_INFO: `/v3/projects/c370b4fa5d9e47be93fe07b79c6c2857/users/ed7d7ea6189b4c73899c6e2c02279fb2/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:13.388179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c370b4fa5d9e47be93fe07b79c6c2857, user_id=ed7d7ea6189b4c73899c6e2c02279fb2, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:13.391373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:13.551372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1106/2212] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:13 2022] PUT /identity/v3/projects/c370b4fa5d9e47be93fe07b79c6c2857/users/ed7d7ea6189b4c73899c6e2c02279fb2/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:13.562909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:13.563990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:13.564433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:13.640271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:13.644760 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] MFA Rules not processed for user `ed7d7ea6189b4c73899c6e2c02279fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:13.646292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:13.780075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1107/2213] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:13.790625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:13.792568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:13.990981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6c80e-5d6a-49c2-9453-f9524ad03da2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:14.004278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb054e-1b34-4afe-ac50-54ca8d2c21f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:14.008094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb054e-1b34-4afe-ac50-54ca8d2c21f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:14.008094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb054e-1b34-4afe-ac50-54ca8d2c21f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:14.008094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb054e-1b34-4afe-ac50-54ca8d2c21f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:14.051234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb054e-1b34-4afe-ac50-54ca8d2c21f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:14.053051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb054e-1b34-4afe-ac50-54ca8d2c21f8 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:14.094046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1107/2214] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:14.603484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:14.605102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:14.761261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1462-4cc2-4800-8a82-5b2b7ff4be0b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:14.761261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1462-4cc2-4800-8a82-5b2b7ff4be0b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:14.761261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f1462-4cc2-4800-8a82-5b2b7ff4be0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:14.790929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c27f1462-4cc2-4800-8a82-5b2b7ff4be0b None None] MFA Rules not processed for user `787efd65008840748e98f9e46e11a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:14.792447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c27f1462-4cc2-4800-8a82-5b2b7ff4be0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:14.797649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a7d16-c2bf-4fff-9595-48fa79a29460 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:14.804172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:14.805698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:14.806382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:14.806670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] PATH_INFO: `/v3/users/304d91c3bc3f472391fd05e833f5b4d5` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:14.809439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=304d91c3bc3f472391fd05e833f5b4d5)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:14.817937 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:14.877276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:14.924851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1108/2215] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:15.093728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304d91c3bc3f472391fd05e833f5b4d5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:15.124607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304d91c3bc3f472391fd05e833f5b4d5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:15.163216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:15.164309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:15.164838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:15.176179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304d91c3bc3f472391fd05e833f5b4d5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:15.177056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304d91c3bc3f472391fd05e833f5b4d5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:15.178410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-88058382-fb50-4607-b39c-452f17b009bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304d91c3bc3f472391fd05e833f5b4d5'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:15.231350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] MFA Rules not processed for user `bc51d114c672470291af52ff627887f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:15.232574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:15.271109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1108/2216] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:14 2022] DELETE /identity/v3/users/304d91c3bc3f472391fd05e833f5b4d5 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:15.275079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:15.275489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:15.275876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:15.335227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:15.338180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:15.364843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:15.420221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1109/2217] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:25:15.437823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:15.438438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:15.501262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1109/2218] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:15.513334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:15.516664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:15.643460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cd85b-4a4c-4490-95c4-cafa6da8c6a9 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:15.780649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350b119-a3d8-4371-ac05-aaafb679b387 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:15.791262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:15.794115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:15.794115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:15.794115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:15.808780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:15.809784 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:15.810319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:15.810994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:15.812766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:15.815054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:15.816389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:15.849759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1110/2219] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:15.939379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:15.986711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:15.988695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:16.016115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1110/2220] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:16.822731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:16.825105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:16.846537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b497af-adcb-47f3-a2c5-af78c8601a4f service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:16.861851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:16.862878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:16.864054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:16.865438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] PATH_INFO: `/v3/projects/7b73ad03d1394008b736632c801e95f1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:16.867852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b73ad03d1394008b736632c801e95f1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:16.870683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:17.035721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b73ad03d1394008b736632c801e95f1', 'request_id': 'req-09528d68-87c5-46ef-a35c-fd4d9b306221'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.044401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b73ad03d1394008b736632c801e95f1', 'request_id': 'req-09528d68-87c5-46ef-a35c-fd4d9b306221'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.051264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b73ad03d1394008b736632c801e95f1', 'request_id': 'req-09528d68-87c5-46ef-a35c-fd4d9b306221'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.153913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] The token cache is being invalidate because project 7b73ad03d1394008b736632c801e95f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:17.154282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.154984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-09528d68-87c5-46ef-a35c-fd4d9b306221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.156642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1111/2221] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:16 2022] DELETE /identity/v3/projects/7b73ad03d1394008b736632c801e95f1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:17.161753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:17.176450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f88f3d-c7d5-47c2-939f-0d68983b41b9 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:17.239110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:17.241626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:17.241626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:17.241626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] PATH_INFO: `/v3/users/ddc1f4745e4d4552822943170de5667d` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:17.242003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc1f4745e4d4552822943170de5667d)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:17.243747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:17.454461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc1f4745e4d4552822943170de5667d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.468661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc1f4745e4d4552822943170de5667d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.589743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc1f4745e4d4552822943170de5667d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.591241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc1f4745e4d4552822943170de5667d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.609360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc1f4745e4d4552822943170de5667d'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:17.623241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1111/2222] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:17 2022] DELETE /identity/v3/users/ddc1f4745e4d4552822943170de5667d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:25:17.867858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:17.868364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:17.868550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:17.906856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:17.911404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:18.002699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:18.161993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1112/2223] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jun 20 12:25:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:18.178269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:18.181381 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:18.259403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:18.315747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979388f-3de3-46d0-a6a8-ee009c26550d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:18.317037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:18.318785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:18.322180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71beaa-0904-456d-9991-d39e2a9116be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:18.323180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71beaa-0904-456d-9991-d39e2a9116be service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:18.323693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71beaa-0904-456d-9991-d39e2a9116be service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:18.324199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71beaa-0904-456d-9991-d39e2a9116be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:18.336705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71beaa-0904-456d-9991-d39e2a9116be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:18.342075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71beaa-0904-456d-9991-d39e2a9116be service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:18.355665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1112/2224] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:25:18.454131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d9be-8bfd-46d4-b3c7-511b789e0472 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:18.459150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:18.460114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:18.460424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:18.462774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] PATH_INFO: `/v3/projects/843266f329d04344b4c6fe58a60640ad` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:18.462981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843266f329d04344b4c6fe58a60640ad)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:18.465023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:18.656933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843266f329d04344b4c6fe58a60640ad', 'request_id': 'req-c835706f-0dfd-4790-8080-20920a7e6eb9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:18.681138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843266f329d04344b4c6fe58a60640ad', 'request_id': 'req-c835706f-0dfd-4790-8080-20920a7e6eb9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:18.688337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843266f329d04344b4c6fe58a60640ad', 'request_id': 'req-c835706f-0dfd-4790-8080-20920a7e6eb9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:18.834945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] The token cache is being invalidate because project 843266f329d04344b4c6fe58a60640ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:18.835351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:18.836166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c835706f-0dfd-4790-8080-20920a7e6eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:18.838279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1113/2225] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:18 2022] DELETE /identity/v3/projects/843266f329d04344b4c6fe58a60640ad => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:18.844390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:18.844682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:18.844965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:18.890002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:18.891255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:18.967008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1113/2226] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:18.969226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:18.969744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:18.969856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.011076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:19.012981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:19.024167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1114/2227] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:19.029007 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.047365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e038cff-6ece-4728-958f-e127ec483ed5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.054812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.056242 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.056626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.056975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.057834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:25:19.058805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.060531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.080778 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1114/2228] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:25:19.082820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.094999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1acdc-e767-48b2-9513-f5f899c3af6e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.105399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.106350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.107272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.107700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.108510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.112216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.169226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.172717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:19.190405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65614da6-2f86-4128-a090-a77ae68b7789 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.201637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.208686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.208686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.208686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] PATH_INFO: `/v3/users/ed7d7ea6189b4c73899c6e2c02279fb2` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.208686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7d7ea6189b4c73899c6e2c02279fb2)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.208686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.255750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1115/2229] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:19.260512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.378375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fe6c5-59a2-43dd-bda7-ad563ac63193 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.384231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.384994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.385372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.385723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.386574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.388577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.469252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7d7ea6189b4c73899c6e2c02279fb2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:19.472009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1116/2230] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:19 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:19.475892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.492530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7d7ea6189b4c73899c6e2c02279fb2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:19.506833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c4be7-9613-47bf-b44f-1ba2fbec9337 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.521287 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.522119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.522476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.522833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.524195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.528609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.551548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1117/2231] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:25:19.556114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.580269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844edca-1d4c-4e81-904a-3892400ede22 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.588150 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7d7ea6189b4c73899c6e2c02279fb2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:19.589001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7d7ea6189b4c73899c6e2c02279fb2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:19.595207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.596005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.596492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.596930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.597845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.599751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9af5c414-c57f-4ecf-9653-9f3bbe509d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7d7ea6189b4c73899c6e2c02279fb2'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:19.600056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.624765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1115/2232] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:19 2022] DELETE /identity/v3/users/ed7d7ea6189b4c73899c6e2c02279fb2 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:19.626320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.631905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1118/2233] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:19.633914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.634062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.635104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.640013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:19.656197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a81fa-1eaf-4e4f-9aa0-8e434202a493 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.666867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:19.669558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:19.803887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74769-51dd-4ca6-ad21-e353a4386408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:19.806456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74769-51dd-4ca6-ad21-e353a4386408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.806456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74769-51dd-4ca6-ad21-e353a4386408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.806456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74769-51dd-4ca6-ad21-e353a4386408 admin admin] PATH_INFO: `/v3/projects/559752c9c98e4648a22042ee421ec72f/users/249a295795d94beb99b491997f382b86/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:19.830032 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74769-51dd-4ca6-ad21-e353a4386408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559752c9c98e4648a22042ee421ec72f, user_id=249a295795d94beb99b491997f382b86, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:19.835124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b74769-51dd-4ca6-ad21-e353a4386408 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:19.844702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1116/2234] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:19.856279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:19.857863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:19.958184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fdb02-7c43-4650-b89a-132d03da6af0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:19.962516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1119/2235] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:19 2022] PUT /identity/v3/projects/559752c9c98e4648a22042ee421ec72f/users/249a295795d94beb99b491997f382b86/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:19.974693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dd536-47f4-41bb-8653-a09c9774c521 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:19.975281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dd536-47f4-41bb-8653-a09c9774c521 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:19.975281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dd536-47f4-41bb-8653-a09c9774c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:20.054076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:20.055414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:20.055767 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:20.056397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:20.060450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-3e8dd536-47f4-41bb-8653-a09c9774c521 None None] MFA Rules not processed for user `249a295795d94beb99b491997f382b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:20.063854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3e8dd536-47f4-41bb-8653-a09c9774c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:20.165079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:20.165079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:20.177699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1117/2236] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:20.201472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1120/2237] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:20.204630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:20.206345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:20.284062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd1831-3502-4d30-986b-b59248ccc214 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:20.284730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:20.285387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:20.285669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:20.285980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:20.297255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:20.298972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:20.318218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1118/2238] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:20.425164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:20.449859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ec34-72cc-4c43-ad39-7651ac99142b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:20.450392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ec34-72cc-4c43-ad39-7651ac99142b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:20.450680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7ec34-72cc-4c43-ad39-7651ac99142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:20.479927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-08d7ec34-72cc-4c43-ad39-7651ac99142b None None] MFA Rules not processed for user `85d4be423d794100ac5b00d32fb5620c`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:20.481172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-08d7ec34-72cc-4c43-ad39-7651ac99142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:20.600680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1121/2239] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:20.837905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:20.839500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:20.862453 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5d33-42c6-47d9-9f7f-02061bbf3950 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:20.880052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:20.880947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:20.881238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:20.881507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] PATH_INFO: `/v3/projects/c370b4fa5d9e47be93fe07b79c6c2857` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:20.883516 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c370b4fa5d9e47be93fe07b79c6c2857)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:20.885508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:20.994896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c370b4fa5d9e47be93fe07b79c6c2857', 'request_id': 'req-764ad366-e7de-48de-ae43-950411eb313f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:21.051889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:21.079839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c370b4fa5d9e47be93fe07b79c6c2857', 'request_id': 'req-764ad366-e7de-48de-ae43-950411eb313f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:21.102580 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c370b4fa5d9e47be93fe07b79c6c2857', 'request_id': 'req-764ad366-e7de-48de-ae43-950411eb313f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:21.120689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] The token cache is being invalidate because project c370b4fa5d9e47be93fe07b79c6c2857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:21.120689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:21.120689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-764ad366-e7de-48de-ae43-950411eb313f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:21.121870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1119/2240] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:20 2022] DELETE /identity/v3/projects/c370b4fa5d9e47be93fe07b79c6c2857 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:21.126782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.127275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.127372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.158870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:21.160086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:21.240736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1122/2241] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:21.251322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.251766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.252086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.272567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:21.274816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:21.284058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1120/2242] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:21.288196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:21.303073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb313e2-8545-40ad-893b-fdd08030720e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:21.310508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:21.311260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.311498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.311779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.312519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:25:21.312829 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:21.314498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:21.327896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1123/2243] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:25:21.332372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:21.342400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb25f60-09df-4a6c-be57-31b4a7af2703 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:21.347127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:21.347774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.348061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.348340 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.349033 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:21.351067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:21.499719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1121/2244] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:21 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:21.503794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:21.514609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9315e7-c07b-4b41-ab69-d2f1d3955715 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:21.586546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:21.588185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.588475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.588922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.589648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:21.594017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:21.705080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1124/2245] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:21 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:25:21.709196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:21.719443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07f877-165e-44c5-9cd1-2ae7e382bcbd admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:21.724299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:21.724956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.725244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.725597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.726407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:21.728171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:21.739122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1122/2246] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:21.743692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:21.754918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2436ccc-3592-480e-845a-e3371f4935e0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:21.762448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a7cb4-ba73-4e98-be9c-e15952ea6532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:21.763440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7cb4-ba73-4e98-be9c-e15952ea6532 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.763733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7cb4-ba73-4e98-be9c-e15952ea6532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.764017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7cb4-ba73-4e98-be9c-e15952ea6532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.764755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a7cb4-ba73-4e98-be9c-e15952ea6532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:21.766716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a7cb4-ba73-4e98-be9c-e15952ea6532 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:21.785057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1125/2247] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:21.789910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:21.799503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1913cb-1b19-43b8-8036-a0c5558e212f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:21.806740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:21.807961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.808335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.808620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] PATH_INFO: `/v3/projects/328ce15596f9499f9551c9274891633a/users/4893a521f9ab4eb3bfab03e2c182dff9/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.827119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328ce15596f9499f9551c9274891633a, user_id=4893a521f9ab4eb3bfab03e2c182dff9, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:21.830293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:21.937673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1123/2248] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:21 2022] PUT /identity/v3/projects/328ce15596f9499f9551c9274891633a/users/4893a521f9ab4eb3bfab03e2c182dff9/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:21.950225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:21.950525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:21.950833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:21.987133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] MFA Rules not processed for user `4893a521f9ab4eb3bfab03e2c182dff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:21.988496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:22.093536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1126/2249] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:22.098861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:22.101031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:22.249483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08853d11-bbde-435b-a334-97df2a37ded9 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:22.256717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:22.259405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:22.262237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:22.263114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:22.287005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:22.290061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:22.325198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1124/2250] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:22.829036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:23.557743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:23.762266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:23.763786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:23.881527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87933a-6f82-458f-879d-6e00ec2dbd82 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:23.888055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:23.888999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:23.889236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:23.889515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] PATH_INFO: `/v3/users/14654ec95611472da8f89705599da7db` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:23.890803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14654ec95611472da8f89705599da7db)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:23.893856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:24.130552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14654ec95611472da8f89705599da7db'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.144808 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14654ec95611472da8f89705599da7db'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.153031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14654ec95611472da8f89705599da7db'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.153783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14654ec95611472da8f89705599da7db'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.154423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f691d544-31ca-4c9e-b442-e6c8188e86a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14654ec95611472da8f89705599da7db'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.259301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1127/2251] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:23 2022] DELETE /identity/v3/users/14654ec95611472da8f89705599da7db => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:24.317082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:24.385915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:24.533176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:24.550151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02c5af-4353-4d7c-a540-887e0261344d service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:24.607359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:24.608227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:24.608515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:24.608792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] PATH_INFO: `/v3/projects/f91f86e458674558b7b62cdd9e945eae` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:24.610029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91f86e458674558b7b62cdd9e945eae)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:24.611946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:24.755911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91f86e458674558b7b62cdd9e945eae', 'request_id': 'req-c6f200f8-b669-4ecd-a31b-a49051605582'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.873936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91f86e458674558b7b62cdd9e945eae', 'request_id': 'req-c6f200f8-b669-4ecd-a31b-a49051605582'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.881388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91f86e458674558b7b62cdd9e945eae', 'request_id': 'req-c6f200f8-b669-4ecd-a31b-a49051605582'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.895321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] The token cache is being invalidate because project f91f86e458674558b7b62cdd9e945eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:24.895692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.896588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c6f200f8-b669-4ecd-a31b-a49051605582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:24.900001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1125/2252] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:24 2022] DELETE /identity/v3/projects/f91f86e458674558b7b62cdd9e945eae => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:24.904936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:24.915416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:24.915963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:24.965190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:24.967062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:25.034989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1128/2253] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:25:25.043853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.044136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.044596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.066134 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:25.071020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:25.088547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1126/2254] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:25.093054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.104614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f92fe9-4275-4ab9-b3ba-10a8b9e8e1d2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.115271 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.116319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.116626 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.117649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.118496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:25:25.118808 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.120485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.133969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1129/2255] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:25:25.138251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.147539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4c75e-8567-4d82-9331-560f00fee1a5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.152633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.153312 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.153603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.153914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.154650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.156565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.271655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1127/2256] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:25 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:25.275793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:25.277119 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.291378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fd36d-8a07-42a6-8b4f-90df4cbb2363 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.352226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.352900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.353215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.353496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.354243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.356193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.440295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1130/2257] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:25 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:25.444604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.457168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c061599-2491-4f8c-9401-bcf8c261667f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.463013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.463678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.464196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.464500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.465184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.467035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.478938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1128/2258] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:25.483816 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.493838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f7128-fefd-42df-89ca-37ac8d35abed admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.499135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a08e06-f23e-44bc-a203-5ec65eca24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.499793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a08e06-f23e-44bc-a203-5ec65eca24a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.500086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a08e06-f23e-44bc-a203-5ec65eca24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.500368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a08e06-f23e-44bc-a203-5ec65eca24a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.501093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a08e06-f23e-44bc-a203-5ec65eca24a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.502780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a08e06-f23e-44bc-a203-5ec65eca24a4 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.512883 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1131/2259] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:25.517448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.529777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55341e9-955d-4b89-8fff-33470bd131d6 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.535035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.536008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.536378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.536660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] PATH_INFO: `/v3/projects/872f7f83013e4381a9df3da7c3cd8d64/users/2eca0648be5b48198c08356ea3e5fd25/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.553834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872f7f83013e4381a9df3da7c3cd8d64, user_id=2eca0648be5b48198c08356ea3e5fd25, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.556797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.559213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:25.657975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1129/2260] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:25 2022] PUT /identity/v3/projects/872f7f83013e4381a9df3da7c3cd8d64/users/2eca0648be5b48198c08356ea3e5fd25/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:25.667851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.668146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.668460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.695786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] MFA Rules not processed for user `2eca0648be5b48198c08356ea3e5fd25`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:25.697035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:25.766162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1132/2261] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:25.781270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:25.783006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:25.841790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce62762-dd4e-4902-9166-e9b0bd585ce8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:25.845428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6330a2-07fc-4c20-9550-bfc3bd70fef8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:25.846108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6330a2-07fc-4c20-9550-bfc3bd70fef8 service glance] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:25.846394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6330a2-07fc-4c20-9550-bfc3bd70fef8 service glance] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:25.846669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6330a2-07fc-4c20-9550-bfc3bd70fef8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:25.856646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6330a2-07fc-4c20-9550-bfc3bd70fef8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:25.858163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6330a2-07fc-4c20-9550-bfc3bd70fef8 service glance] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:25.869074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1130/2262] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:33.084098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:33.085730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:33.115857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:33.156186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a4e5-96fd-44fe-8600-353701f5ae19 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:33.160815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:33.161698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:33.162013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:33.162290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] PATH_INFO: `/v3/users/4893a521f9ab4eb3bfab03e2c182dff9` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:33.163495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4893a521f9ab4eb3bfab03e2c182dff9)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:33.166077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:33.446073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4893a521f9ab4eb3bfab03e2c182dff9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:33.464836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4893a521f9ab4eb3bfab03e2c182dff9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:33.472035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4893a521f9ab4eb3bfab03e2c182dff9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:33.473129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4893a521f9ab4eb3bfab03e2c182dff9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:33.473462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4893a521f9ab4eb3bfab03e2c182dff9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:33.585086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1133/2263] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:33 2022] DELETE /identity/v3/users/4893a521f9ab4eb3bfab03e2c182dff9 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:33.594837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:33.595346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:33.595441 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:33.619687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:33.619687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:33.682432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1131/2264] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:25:33.691519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:33.692935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:33.756920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfadbc-808d-4799-930b-cbe579741717 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:33.761317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:33.762125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:33.762418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:33.762700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:33.772775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:33.774676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:33.787294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1134/2265] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:33.880465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:33.883034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:33.898380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9983-9d07-4ec0-91c5-dfc3f34f734e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:33.904590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:33.905275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:33.905600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:33.905987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] PATH_INFO: `/v3/users/843d2e076e7c445e8b6d25f7c7554f9b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:33.907401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=843d2e076e7c445e8b6d25f7c7554f9b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:33.909421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:34.163745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843d2e076e7c445e8b6d25f7c7554f9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.189592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843d2e076e7c445e8b6d25f7c7554f9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.252811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:34.254563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:34.269312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab15d6-edf9-40a8-b0cf-8df42229924a service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:34.274334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:34.276194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.276486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.276779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] PATH_INFO: `/v3/projects/328ce15596f9499f9551c9274891633a` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.278396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328ce15596f9499f9551c9274891633a)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:34.282065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843d2e076e7c445e8b6d25f7c7554f9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.282722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843d2e076e7c445e8b6d25f7c7554f9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.284221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:34.296073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ec63ef07-21ee-44ea-a902-2241b791e81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843d2e076e7c445e8b6d25f7c7554f9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.308222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1132/2266] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:33 2022] DELETE /identity/v3/users/843d2e076e7c445e8b6d25f7c7554f9b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:34.310041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.310388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.310949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.330721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:34.332000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:34.336415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:34.404259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1133/2267] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:34.415181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:34.417364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:34.445098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:34.452239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328ce15596f9499f9551c9274891633a', 'request_id': 'req-e82ca095-004c-4390-ba82-418c45c30db1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.464188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328ce15596f9499f9551c9274891633a', 'request_id': 'req-e82ca095-004c-4390-ba82-418c45c30db1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.471976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328ce15596f9499f9551c9274891633a', 'request_id': 'req-e82ca095-004c-4390-ba82-418c45c30db1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.491639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9ff4-ffe8-429d-94f4-1fa40ec95933 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:34.545231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f21133-43ea-488e-baa4-abfa9c8ca5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:34.545916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f21133-43ea-488e-baa4-abfa9c8ca5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.546199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f21133-43ea-488e-baa4-abfa9c8ca5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.546475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f21133-43ea-488e-baa4-abfa9c8ca5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.614860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f21133-43ea-488e-baa4-abfa9c8ca5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:34.614860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f21133-43ea-488e-baa4-abfa9c8ca5e4 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:34.624589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] The token cache is being invalidate because project 328ce15596f9499f9551c9274891633a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:34.625025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.626272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e82ca095-004c-4390-ba82-418c45c30db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:34.626646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1134/2268] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:25:34.631745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1135/2269] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:34 2022] DELETE /identity/v3/projects/328ce15596f9499f9551c9274891633a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:34.639047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.639047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.639376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.673199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:34.674235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:34.685860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1135/2270] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:34.691343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.694171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.694171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.713171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:34.714645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:34.724990 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1136/2271] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:34.732868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:34.741272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a6bb0-5e74-4d6f-a84d-598527d300c0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:34.747455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:34.748194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.748418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.757361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.758358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:25:34.758680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:34.760836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:34.794593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1136/2272] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:25:34.798118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:34.819283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6250fd-4bde-4057-9230-de7f0afac435 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:34.825645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:34.826939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:34.827838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:34.828228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:34.829046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:34.831114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:34.945402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1137/2273] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:34 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:34.950048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:34.972025 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8013-c44f-4b9a-a861-a27769cfd635 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:35.046053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:35.046734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.047020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.047299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.048262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:35.052112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:35.148892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1137/2274] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:34 2022] POST /identity/v3/users => generated 282 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:35.153960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:35.166842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d7278-612e-4fb7-a1ea-a08b3a76826c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:35.172134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:35.172822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.173226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.173378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.174438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:35.176438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:35.196054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1138/2275] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:35.197648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:35.197895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:35.200044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:35.217539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9160-9789-42a7-8724-65c386662ba5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:35.223446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba52590-b77b-4e4a-a051-aec8f8075edc admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:35.225784 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:35.227082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.227182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.227495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] PATH_INFO: `/v3/projects/5a57f50c24d941e0a8466917a2928316` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.228981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a57f50c24d941e0a8466917a2928316)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:35.229445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:35.230152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.230444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.230722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.231456 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:35.231673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:35.233071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:35.245398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1139/2276] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:35.249933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:35.262123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0593f90-d2fc-4c49-b5ad-d0bcf1eab211 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:35.267236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231d58a-8119-4de8-868a-fe93253f2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:35.268130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d58a-8119-4de8-868a-fe93253f2f66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.268420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d58a-8119-4de8-868a-fe93253f2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.269101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231d58a-8119-4de8-868a-fe93253f2f66 admin admin] PATH_INFO: `/v3/projects/5b342276d03948818be85c248cb982e3/users/94107d695c9b404d8e06e20c24a972c8/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.286543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d58a-8119-4de8-868a-fe93253f2f66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b342276d03948818be85c248cb982e3, user_id=94107d695c9b404d8e06e20c24a972c8, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:35.289216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231d58a-8119-4de8-868a-fe93253f2f66 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:35.403908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:35.410374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1140/2277] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:35 2022] PUT /identity/v3/projects/5b342276d03948818be85c248cb982e3/users/94107d695c9b404d8e06e20c24a972c8/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:35.421789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.422117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.422401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.424644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a57f50c24d941e0a8466917a2928316', 'request_id': 'req-a64129f7-5353-48fa-bb85-0e245679daf0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:35.454719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] MFA Rules not processed for user `94107d695c9b404d8e06e20c24a972c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:35.455939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:35.499552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a57f50c24d941e0a8466917a2928316', 'request_id': 'req-a64129f7-5353-48fa-bb85-0e245679daf0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:35.507703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a57f50c24d941e0a8466917a2928316', 'request_id': 'req-a64129f7-5353-48fa-bb85-0e245679daf0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:35.531292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] The token cache is being invalidate because project 5a57f50c24d941e0a8466917a2928316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:35.531776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1141/2278] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:25:35.531901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:35.532538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:35.542916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1138/2279] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:35 2022] DELETE /identity/v3/projects/5a57f50c24d941e0a8466917a2928316 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:35.573038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:35.578426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:35.675958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:35.692951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a757f-b2b7-421f-aa9c-059b0d0d1a04 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:35.695126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:35.695791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:35.696077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:35.696358 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:35.699224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:35.713323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:35.714604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d86212-41f2-48d0-aaaa-79217713919c service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:35.728159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1142/2280] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:45.805960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=62,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:46.442197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=6 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:46.871755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:46.873324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:46.942301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64129f7-5353-48fa-bb85-0e245679daf0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:46.946875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:46.947744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:46.948024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:46.948294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] PATH_INFO: `/v3/users/249a295795d94beb99b491997f382b86` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:46.949645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249a295795d94beb99b491997f382b86)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:46.951924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:47.173878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249a295795d94beb99b491997f382b86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:47.191492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249a295795d94beb99b491997f382b86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:47.294748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249a295795d94beb99b491997f382b86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:47.295618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249a295795d94beb99b491997f382b86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:47.303431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249a295795d94beb99b491997f382b86'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:47.310284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1139/2281] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:25:46 2022] DELETE /identity/v3/users/249a295795d94beb99b491997f382b86 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:47.314902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:47.315255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:47.315653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:47.333265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:47.334506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:47.400627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1143/2282] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:47.412199 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:47.413669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:47.478880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dea24-2941-477e-8f10-2ca13d1872f8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:47.483412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0354a07-52e5-4e48-9d44-3e52c1162315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:47.484065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0354a07-52e5-4e48-9d44-3e52c1162315 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:47.484351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0354a07-52e5-4e48-9d44-3e52c1162315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:47.484630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0354a07-52e5-4e48-9d44-3e52c1162315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:47.494616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0354a07-52e5-4e48-9d44-3e52c1162315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:47.496072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0354a07-52e5-4e48-9d44-3e52c1162315 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:47.505741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1140/2283] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:47.927114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:47.928600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:47.941179 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2be82d-8acb-4a8a-ac53-b847cb196c97 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:47.947151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:47.948056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:47.948341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:47.948619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] PATH_INFO: `/v3/projects/559752c9c98e4648a22042ee421ec72f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:47.950406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=559752c9c98e4648a22042ee421ec72f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:47.953052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.067165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559752c9c98e4648a22042ee421ec72f', 'request_id': 'req-4600e898-784a-473a-ae1b-708c9db8f671'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:48.073932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559752c9c98e4648a22042ee421ec72f', 'request_id': 'req-4600e898-784a-473a-ae1b-708c9db8f671'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:48.080428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559752c9c98e4648a22042ee421ec72f', 'request_id': 'req-4600e898-784a-473a-ae1b-708c9db8f671'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:48.171711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] The token cache is being invalidate because project 559752c9c98e4648a22042ee421ec72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:25:48.172010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:48.173606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4600e898-784a-473a-ae1b-708c9db8f671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:25:48.174432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1144/2284] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:25:47 2022] DELETE /identity/v3/projects/559752c9c98e4648a22042ee421ec72f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:48.179461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.180137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.180137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.199141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:48.201051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:48.218814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:48.268781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1141/2285] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:25:48.276542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.276957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.277244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.297566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:48.298880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:48.307261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1145/2286] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:48.312017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.322809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18cc6b-f6eb-4aae-a958-a90821ea0653 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:48.328406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:48.329080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.329363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.330302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.330429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:25:48.330741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:48.332380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.347427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1142/2287] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:25:48.351761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.366715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb2727-b4c4-4341-bb04-21c8057cc926 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:48.373820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:48.375445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.375729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.376414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.377125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:48.379342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.484754 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1146/2288] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:25:48 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:48.489146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.500321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745fd89-f6b9-427f-9817-a27a1845074c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:48.561705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:48.562446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.562891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.563055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.563783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:48.565740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.658682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1143/2289] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:25:48 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:25:48.662944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.674408 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305370f7-4c49-4713-bf69-0efacfb5bdff admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:48.680543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:48.681245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.681658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.682008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.682742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:48.684605 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.696189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1147/2290] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:48.700561 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.711431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8d50d-b134-4477-86e0-ae9221ebe898 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:48.716288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934827d9-5b2d-4f67-ae03-3c61ff76419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:48.717440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934827d9-5b2d-4f67-ae03-3c61ff76419e admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.717990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934827d9-5b2d-4f67-ae03-3c61ff76419e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.718276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934827d9-5b2d-4f67-ae03-3c61ff76419e admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.719190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934827d9-5b2d-4f67-ae03-3c61ff76419e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:48.721659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934827d9-5b2d-4f67-ae03-3c61ff76419e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.735512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1144/2291] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:25:48.740792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.751701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697dc66d-ee4a-4d48-832d-c6d526184f6c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:48.756864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:48.757774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.758090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.758372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] PATH_INFO: `/v3/projects/66aa50dfcb9343dc97a3ac45e14d84e8/users/544ecbe3ff7043fea3219a74c659cfbc/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.778318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66aa50dfcb9343dc97a3ac45e14d84e8, user_id=544ecbe3ff7043fea3219a74c659cfbc, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:48.782475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:48.878802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1148/2292] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:25:48 2022] PUT /identity/v3/projects/66aa50dfcb9343dc97a3ac45e14d84e8/users/544ecbe3ff7043fea3219a74c659cfbc/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:25:48.887772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9f6f-c8ad-473d-96b8-78da084f911e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:48.888071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9f6f-c8ad-473d-96b8-78da084f911e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:48.888359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9f6f-c8ad-473d-96b8-78da084f911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:48.917490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-29eb9f6f-c8ad-473d-96b8-78da084f911e None None] MFA Rules not processed for user `544ecbe3ff7043fea3219a74c659cfbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:48.919286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-29eb9f6f-c8ad-473d-96b8-78da084f911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:48.982834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1145/2293] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:48.993275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:48.995014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:49.018431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:49.073636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70680e48-aa1b-4eeb-87f8-cb5f60880411 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:49.077537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:49.078360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:49.078644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:49.078921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:49.087835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:49.089327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:49.099766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1149/2294] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:25:58.081623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:58.082562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:58.082921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:58.101371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] MFA Rules not processed for user `ec4c5293e6a148a2a16ba4c3fc57a3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:25:58.102620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:58.114537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:58.159214 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1146/2295] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:25:59.122817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=26 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:25:59.640410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:25:59.641954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:59.748709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b39674-c3fd-4a91-a8b1-ad8fdd2e0ef5 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:25:59.754992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:25:59.755738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:25:59.756083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:25:59.762992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:25:59.762992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:25:59.773154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:25:59.775094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e20790-5bac-4087-8212-aede64d8a611 service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:25:59.789283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1150/2296] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:04.963062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:05.038901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc75f9-8e57-464e-86c9-c2a261488e1c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:05.043537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:05.044741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:05.045030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:05.045331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] PATH_INFO: `/v3/users/544ecbe3ff7043fea3219a74c659cfbc` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:05.046782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544ecbe3ff7043fea3219a74c659cfbc)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:05.048878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:05.295702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544ecbe3ff7043fea3219a74c659cfbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:05.312216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544ecbe3ff7043fea3219a74c659cfbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:05.391868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544ecbe3ff7043fea3219a74c659cfbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:05.392492 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544ecbe3ff7043fea3219a74c659cfbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:05.400122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544ecbe3ff7043fea3219a74c659cfbc'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:05.406796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1147/2297] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:26:04 2022] DELETE /identity/v3/users/544ecbe3ff7043fea3219a74c659cfbc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:05.411429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:05.412499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:05.412499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:05.430998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:05.432220 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:05.491791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1151/2298] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:05.502956 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:05.504402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:05.551646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:05.563831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07fac-7dfb-49d8-bfed-6b7124cd3145 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:05.567576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a03e82-fa4a-4656-ae9b-393cd4a08f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:05.568249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03e82-fa4a-4656-ae9b-393cd4a08f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:05.568539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03e82-fa4a-4656-ae9b-393cd4a08f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:05.568958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a03e82-fa4a-4656-ae9b-393cd4a08f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:05.580328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03e82-fa4a-4656-ae9b-393cd4a08f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:05.581843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a03e82-fa4a-4656-ae9b-393cd4a08f28 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:05.591985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1148/2299] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:06.050834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.052261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:06.065860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac25a8a-db82-4ca1-a56e-258786b11753 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.071103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.071980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.072264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.072548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] PATH_INFO: `/v3/projects/66aa50dfcb9343dc97a3ac45e14d84e8` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.074497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=66aa50dfcb9343dc97a3ac45e14d84e8)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.077997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.188113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66aa50dfcb9343dc97a3ac45e14d84e8', 'request_id': 'req-6af5219c-7964-4a1d-be11-16e7a18a72fa'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:06.194690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66aa50dfcb9343dc97a3ac45e14d84e8', 'request_id': 'req-6af5219c-7964-4a1d-be11-16e7a18a72fa'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:06.201148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66aa50dfcb9343dc97a3ac45e14d84e8', 'request_id': 'req-6af5219c-7964-4a1d-be11-16e7a18a72fa'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:06.204150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:06.318030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] The token cache is being invalidate because project 66aa50dfcb9343dc97a3ac45e14d84e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:26:06.318433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:06.329190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6af5219c-7964-4a1d-be11-16e7a18a72fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:06.329190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1152/2300] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:26:06 2022] DELETE /identity/v3/projects/66aa50dfcb9343dc97a3ac45e14d84e8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:06.329480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.329480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.329480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.351711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:06.353096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:06.416645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1149/2301] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:06.425409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.425904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.425999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.445690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:06.446921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:06.455965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1153/2302] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:06.460216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.471028 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3509d-91a9-4560-ac29-e8621a668835 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.475680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.476345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.476634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.476917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.477680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:26:06.478031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.479666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.491480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1150/2303] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:26:06.495976 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.506742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724a939-2430-49dc-b53a-2fa442b681fc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.511516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.512181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.513195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.513477 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.514215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.516146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.600040 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1154/2304] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:26:06 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:06.604279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.615500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128f721-ea12-4c49-8875-6a678e36b8a7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.673898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.674565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.674850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.675152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.675849 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.677854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.775092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1151/2305] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:26:06 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:06.779877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.790222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b56a4-b99b-40e7-a235-984bdc76b6be admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.796218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.796923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.797256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.797498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.798284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.799931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.812089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1155/2306] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:06.816160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.826777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da270b-0c43-4928-9e59-136e0819c71c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.831977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afb3cc-74ce-4f7a-ba0f-705666d920cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.832648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afb3cc-74ce-4f7a-ba0f-705666d920cf admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.832934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afb3cc-74ce-4f7a-ba0f-705666d920cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.833218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afb3cc-74ce-4f7a-ba0f-705666d920cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.833988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afb3cc-74ce-4f7a-ba0f-705666d920cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.835594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afb3cc-74ce-4f7a-ba0f-705666d920cf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.846693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1152/2307] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:06.850895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:06.861478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17059b9-2c78-464e-b015-8ec2dcbc4184 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:06.866311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:06.867197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.867488 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.867771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] PATH_INFO: `/v3/projects/d9b0e8111c084f769bbc267365364900/users/7c5ef23fbdb145bfa485859ff4c43b4c/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.883324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b0e8111c084f769bbc267365364900, user_id=7c5ef23fbdb145bfa485859ff4c43b4c, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:06.886052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:06.960741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1156/2308] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:06 2022] PUT /identity/v3/projects/d9b0e8111c084f769bbc267365364900/users/7c5ef23fbdb145bfa485859ff4c43b4c/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:06.965748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c0de-b6a5-4a01-a551-c56b1cb1254a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:06.966084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c0de-b6a5-4a01-a551-c56b1cb1254a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:06.966371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c0de-b6a5-4a01-a551-c56b1cb1254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:06.985144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0bb0c0de-b6a5-4a01-a551-c56b1cb1254a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:06.986443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0bb0c0de-b6a5-4a01-a551-c56b1cb1254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:07.034077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:07.052600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1153/2309] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:07.063054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:07.064840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:07.126933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b57c4-4713-4721-b91e-ea2daa7d33cf admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:07.130475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:07.131118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:07.131397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:07.131672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:07.141367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:07.142859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:07.153418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1157/2310] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:08.501832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91836f-ce0a-44a3-82ee-4a4b2a666c22 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:08.502361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91836f-ce0a-44a3-82ee-4a4b2a666c22 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:08.502603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91836f-ce0a-44a3-82ee-4a4b2a666c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:08.535774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ef91836f-ce0a-44a3-82ee-4a4b2a666c22 None None] MFA Rules not processed for user `7c5ef23fbdb145bfa485859ff4c43b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:08.537965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ef91836f-ce0a-44a3-82ee-4a4b2a666c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:08.625854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1154/2311] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:08.636782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:08.638847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:08.709948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89c331-1dba-4664-986b-855927c20b37 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:08.713638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:08.714321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:08.714635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:08.714921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:08.724674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:08.726187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:08.735514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1158/2312] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:10.711377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180171de-9905-408e-b172-ea0699ef7efd None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:10.711987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180171de-9905-408e-b172-ea0699ef7efd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:10.711987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180171de-9905-408e-b172-ea0699ef7efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:10.736890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-180171de-9905-408e-b172-ea0699ef7efd None None] MFA Rules not processed for user `7c5ef23fbdb145bfa485859ff4c43b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:10.738098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-180171de-9905-408e-b172-ea0699ef7efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:10.745114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1155/2313] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:14.822762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:14.824243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:14.838912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8ec4c-8d85-4157-8c09-cdd8ae6ab439 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:14.843502 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:14.844400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:14.844727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:14.845004 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] PATH_INFO: `/v3/users/2eca0648be5b48198c08356ea3e5fd25` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:14.846210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eca0648be5b48198c08356ea3e5fd25)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:14.848132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:15.029963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:15.042952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eca0648be5b48198c08356ea3e5fd25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:15.055107 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eca0648be5b48198c08356ea3e5fd25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:15.063945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eca0648be5b48198c08356ea3e5fd25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:15.064688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eca0648be5b48198c08356ea3e5fd25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:15.065538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eca0648be5b48198c08356ea3e5fd25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:15.149448 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1159/2314] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:26:14 2022] DELETE /identity/v3/users/2eca0648be5b48198c08356ea3e5fd25 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:15.154138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:15.154599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:15.154692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:15.173757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:15.177568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:15.235478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1156/2315] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:15.245372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:15.246831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:15.306974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55246b84-3888-4dd5-a9d5-bc91cfe6d3b7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:15.311390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec57815-ead4-4357-9eca-23229cfd572f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:15.312029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57815-ead4-4357-9eca-23229cfd572f service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:15.312312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57815-ead4-4357-9eca-23229cfd572f service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:15.312591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec57815-ead4-4357-9eca-23229cfd572f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:15.321548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec57815-ead4-4357-9eca-23229cfd572f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:15.323036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec57815-ead4-4357-9eca-23229cfd572f service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:15.332774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1160/2316] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:15.784098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:15.786379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:15.803285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248ddbd-9bf7-42d6-bea0-c967a3481f5c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:15.808409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:15.813119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:15.813119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:15.813119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] PATH_INFO: `/v3/projects/872f7f83013e4381a9df3da7c3cd8d64` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:15.813119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872f7f83013e4381a9df3da7c3cd8d64)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:15.813980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:15.930096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872f7f83013e4381a9df3da7c3cd8d64', 'request_id': 'req-b6bbdc53-2aab-473c-8d2b-bb291330e640'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:16.030419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872f7f83013e4381a9df3da7c3cd8d64', 'request_id': 'req-b6bbdc53-2aab-473c-8d2b-bb291330e640'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:16.036506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872f7f83013e4381a9df3da7c3cd8d64', 'request_id': 'req-b6bbdc53-2aab-473c-8d2b-bb291330e640'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:16.045471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:16.050389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] The token cache is being invalidate because project 872f7f83013e4381a9df3da7c3cd8d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:26:16.050698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:16.051382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b6bbdc53-2aab-473c-8d2b-bb291330e640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:16.053289 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1157/2317] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:26:15 2022] DELETE /identity/v3/projects/872f7f83013e4381a9df3da7c3cd8d64 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:16.057967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.058451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.058766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.085943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:16.087197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:16.160636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1161/2318] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:16.169200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.171132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.171132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.194309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:16.198641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:16.208200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1158/2319] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:16.213097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:16.224962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81b2a1-7ee7-4625-955c-150fb5651f7b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:16.231467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:16.232206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.232496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.232973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.234926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:26:16.235247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:16.237052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:16.251101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1162/2320] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:26:16.255423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:16.265178 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17b0fb-2303-4723-b724-3f906e2a3e5c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:16.269862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:16.270517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.279819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.279819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.279819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:16.279819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:16.409701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1159/2321] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:26:16 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:16.413695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:16.425687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1043c-a81c-4d0a-a6f1-dcec38779571 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:16.460895 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:16.490653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:16.491866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.492190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.492420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.493132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:16.495357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:16.600036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1163/2322] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:26:16 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:26:16.600806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:16.612073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01b17e-4256-4e2e-a0a9-6ba5d5e7ee3e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:16.616874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:16.617609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.618022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.618375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.619170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:16.620770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:16.632428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1160/2323] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:26:16.636566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:16.648452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ecd49-7e17-4e52-a4f3-52349ff62858 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:16.653402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d88a54-d4f7-433e-8285-44285702876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:16.654269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88a54-d4f7-433e-8285-44285702876c admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.654558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88a54-d4f7-433e-8285-44285702876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.654977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d88a54-d4f7-433e-8285-44285702876c admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.655904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88a54-d4f7-433e-8285-44285702876c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:16.657458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d88a54-d4f7-433e-8285-44285702876c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:16.681394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1164/2324] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:16.682647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:16.695188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040712ea-23df-44ee-881f-b52dbf767fc0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:16.700995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:16.702232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.702593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.702941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] PATH_INFO: `/v3/projects/bc8e8f6dd9a64c278177e8178303e279/users/0b94d414c1ec4999b04a003f18f05587/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.722348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc8e8f6dd9a64c278177e8178303e279, user_id=0b94d414c1ec4999b04a003f18f05587, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:16.725225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:16.808090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1161/2325] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:16 2022] PUT /identity/v3/projects/bc8e8f6dd9a64c278177e8178303e279/users/0b94d414c1ec4999b04a003f18f05587/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:16.818630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:16.818861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:16.819124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:16.854681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] MFA Rules not processed for user `0b94d414c1ec4999b04a003f18f05587`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:16.856117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:17.007294 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1165/2326] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:17.024128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:17.026351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:17.096790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4385d3-e500-455d-9215-c37de7f20889 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:17.100610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9849381-2d51-407f-8a65-2811a7f55d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:17.101543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849381-2d51-407f-8a65-2811a7f55d54 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:17.101850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849381-2d51-407f-8a65-2811a7f55d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:17.106806 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9849381-2d51-407f-8a65-2811a7f55d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:17.112358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9849381-2d51-407f-8a65-2811a7f55d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:17.114138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9849381-2d51-407f-8a65-2811a7f55d54 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:17.124759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1162/2327] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:26:17.151843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:17.223257 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323a57-814a-4eb3-82b3-e4a967620147 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:17.228249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:17.229196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:17.229477 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:17.229751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] PATH_INFO: `/v3/users/0b94d414c1ec4999b04a003f18f05587` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:17.231185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b94d414c1ec4999b04a003f18f05587)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:17.233284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:17.565632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b94d414c1ec4999b04a003f18f05587'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:17.567095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:17.583014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b94d414c1ec4999b04a003f18f05587'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:17.590599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b94d414c1ec4999b04a003f18f05587'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:17.592426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b94d414c1ec4999b04a003f18f05587'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:17.593050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b94d414c1ec4999b04a003f18f05587'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:17.680564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1166/2328] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:26:17 2022] DELETE /identity/v3/users/0b94d414c1ec4999b04a003f18f05587 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:17.685776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:17.686276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:17.686389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:17.704126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:17.705345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:17.770309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1163/2329] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:17.780930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:17.782462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:17.866778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265eb8f-ab7c-4d82-8a8e-2ac8b2f7ef78 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:17.871570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843955cf-67f6-4056-aa74-c2eb95a0946c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:17.872225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843955cf-67f6-4056-aa74-c2eb95a0946c service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:17.873190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843955cf-67f6-4056-aa74-c2eb95a0946c service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:17.873400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843955cf-67f6-4056-aa74-c2eb95a0946c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:17.885307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843955cf-67f6-4056-aa74-c2eb95a0946c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:17.886880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843955cf-67f6-4056-aa74-c2eb95a0946c service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:17.899727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1167/2330] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:18.536391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:18.538833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:18.556700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda5d47-5cc8-4228-926d-310056d68e99 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:18.564854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:18.564854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:18.564854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:18.564854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] PATH_INFO: `/v3/projects/bc8e8f6dd9a64c278177e8178303e279` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:18.565898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc8e8f6dd9a64c278177e8178303e279)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:18.568352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:18.703021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:18.714421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc8e8f6dd9a64c278177e8178303e279', 'request_id': 'req-5e74c694-598e-4760-93ba-6bf5707618ee'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:18.828160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc8e8f6dd9a64c278177e8178303e279', 'request_id': 'req-5e74c694-598e-4760-93ba-6bf5707618ee'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:18.835502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc8e8f6dd9a64c278177e8178303e279', 'request_id': 'req-5e74c694-598e-4760-93ba-6bf5707618ee'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:18.849844 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] The token cache is being invalidate because project bc8e8f6dd9a64c278177e8178303e279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:26:18.854617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:18.854617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e74c694-598e-4760-93ba-6bf5707618ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:18.854617 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1164/2331] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:26:18 2022] DELETE /identity/v3/projects/bc8e8f6dd9a64c278177e8178303e279 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:18.860755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:18.861243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:18.861372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:18.908803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:18.910115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:18.993323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1168/2332] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:19.001576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.002151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.002438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.024451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:19.025865 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:19.039913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1165/2333] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:19.041240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.051648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f848fe8-9e7f-41ef-a591-35ec0ee787ef None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.057390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.058101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.058386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.058766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.059400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:26:19.059756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.061997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.082364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1169/2334] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:26:19.095759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.106187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd67ef-d9a8-4564-a67b-37e13e0c6429 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.111554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.112226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.112542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.112828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.113704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.115744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.239261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1166/2335] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:26:19 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:19.240654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.252097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d2395-d7b5-449a-83ef-e9d0b94a1471 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.304649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:19.311689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.312370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.312657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.312941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.313642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.315650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.430489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1170/2336] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:26:19 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:19.432424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.445712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0764f-bab2-43ed-a918-7fb34be06f15 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.450641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.451555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.451891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.452173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.452918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.463939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.465545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1167/2337] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:19.471463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.481619 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14889730-f999-4091-88b1-dbcacb77e836 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.487382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52613091-0d04-472e-88d7-43b8fb27c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.492526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613091-0d04-472e-88d7-43b8fb27c7da admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.492526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613091-0d04-472e-88d7-43b8fb27c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.492526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52613091-0d04-472e-88d7-43b8fb27c7da admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.492526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52613091-0d04-472e-88d7-43b8fb27c7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.492526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52613091-0d04-472e-88d7-43b8fb27c7da admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.505057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1171/2338] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:19.506298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.519101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f8abc-b7ef-4c3e-a3b7-ab4e24e80ca2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.524132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.527105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.527105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.527105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] PATH_INFO: `/v3/projects/68f8e01a266c4737ad5fa510ed9b2fad/users/648c1ba14f1842a5b4160a7569e3206e/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.542598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f8e01a266c4737ad5fa510ed9b2fad, user_id=648c1ba14f1842a5b4160a7569e3206e, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.545763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.676268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1168/2339] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:19 2022] PUT /identity/v3/projects/68f8e01a266c4737ad5fa510ed9b2fad/users/648c1ba14f1842a5b4160a7569e3206e/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:19.681728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.682075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.682392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.701022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:19.702467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:19.774559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1172/2340] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:19.784905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:19.786764 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:19.898395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98b48-f47d-43af-8ef0-7798e2dd811c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:19.902269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:19.902930 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:19.903203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:19.903771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:19.917240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:19.919533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:19.939789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1169/2341] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:21.182845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:21.184230 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:21.197646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f1718-8b84-43bd-93d5-063bf33dfd2d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:21.202382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:21.203036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:21.203319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:21.203597 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:21.205387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:21.276402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:21.278276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7de68-b0fb-4680-8407-cb428e37400d service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:21.288960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1173/2342] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:24.166438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:24.168739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:24.182415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e30dec-6942-4589-b0f0-315c132f5b82 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:24.188086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:24.189141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:24.189573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:24.190027 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] PATH_INFO: `/v3/users/94107d695c9b404d8e06e20c24a972c8` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:24.191402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94107d695c9b404d8e06e20c24a972c8)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:24.193489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:24.452369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94107d695c9b404d8e06e20c24a972c8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:24.467603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:24.481160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94107d695c9b404d8e06e20c24a972c8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:24.581795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94107d695c9b404d8e06e20c24a972c8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:24.582603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94107d695c9b404d8e06e20c24a972c8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:24.592255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94107d695c9b404d8e06e20c24a972c8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:24.599682 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1170/2343] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:26:24 2022] DELETE /identity/v3/users/94107d695c9b404d8e06e20c24a972c8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:24.604521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:24.604993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:24.605171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:24.648967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:24.653550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:24.746546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1174/2344] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:24.756385 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:24.762345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:24.831962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9180-49e3-4d6e-8318-af313a70ebf7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:24.836458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1aa1e1-2da4-41ca-9e36-25784379c70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:24.836726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa1e1-2da4-41ca-9e36-25784379c70d service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:24.837200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa1e1-2da4-41ca-9e36-25784379c70d service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:24.837545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1aa1e1-2da4-41ca-9e36-25784379c70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:24.852003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa1e1-2da4-41ca-9e36-25784379c70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:24.858039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1aa1e1-2da4-41ca-9e36-25784379c70d service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:24.879382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1171/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:26:25.933723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:25.937587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:25.984581 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bfe10-cb83-4e26-9ccd-4a46e3d5e865 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:25.998332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:25.999577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:25.999862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.000155 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] PATH_INFO: `/v3/projects/5b342276d03948818be85c248cb982e3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.001527 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b342276d03948818be85c248cb982e3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.005667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:26.008856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:26.170376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b342276d03948818be85c248cb982e3', 'request_id': 'req-6e691966-172a-4a7e-bf00-632d057db2cf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:26.180330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b342276d03948818be85c248cb982e3', 'request_id': 'req-6e691966-172a-4a7e-bf00-632d057db2cf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:26.189270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b342276d03948818be85c248cb982e3', 'request_id': 'req-6e691966-172a-4a7e-bf00-632d057db2cf'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:26.299083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] The token cache is being invalidate because project 5b342276d03948818be85c248cb982e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:26:26.299451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:26.300178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6e691966-172a-4a7e-bf00-632d057db2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:26:26.302346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1175/2346] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:26:25 2022] DELETE /identity/v3/projects/5b342276d03948818be85c248cb982e3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:26.306899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.307362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.307474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.328434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:26.329902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:26.418526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1172/2347] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:26.428130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3956-549d-459e-a568-c50244593723 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.428417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3956-549d-459e-a568-c50244593723 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.428695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c3956-549d-459e-a568-c50244593723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.447781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-695c3956-549d-459e-a568-c50244593723 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:26.449021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-695c3956-549d-459e-a568-c50244593723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:26.458428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1176/2348] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:26.462528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:26.473315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556194c1-bc1a-43ac-9016-23384ea2fe72 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:26.478402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:26.479306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.479825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.480412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.481345 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:26:26.481876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.484091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:26.498476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1173/2349] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:26:26.503997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3956-549d-459e-a568-c50244593723 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:26.526011 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c3956-549d-459e-a568-c50244593723 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:26.533608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:26.536259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.536259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.536259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.536259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.538958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:26.643871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1177/2350] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:26.648157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:26.659979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec9852-b2aa-42f0-afb9-de16f8c8814c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:26.732117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:26.732774 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.733077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.736424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.736424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.736424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:26.744010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:26.838198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1174/2351] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:26:26 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:26.838398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:26.848916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a1d9-7b5f-44bb-b1a8-98311a160048 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:26.861662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:26.864232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.864733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.866285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.867558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.871246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:26.886388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1178/2352] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:26.891049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:26.903294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91bea-d324-4a18-a12c-37016d2e0262 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:26.909878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6553f03-cea1-4bc7-ae99-fdac97bae605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:26.910307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553f03-cea1-4bc7-ae99-fdac97bae605 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.910641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553f03-cea1-4bc7-ae99-fdac97bae605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.910923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6553f03-cea1-4bc7-ae99-fdac97bae605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.911654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6553f03-cea1-4bc7-ae99-fdac97bae605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.913301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6553f03-cea1-4bc7-ae99-fdac97bae605 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:26.929740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1175/2353] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:26.931065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:26.954571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03cdab-4b3b-40f4-89d3-0f2d4ca3d400 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:26.960682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:26.961759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:26.962072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:26.962348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] PATH_INFO: `/v3/projects/7a033c0ad5484ff89949482c587ea5e7/users/4c0fe72487114f47ad7944b05d3698b1/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:26.981299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a033c0ad5484ff89949482c587ea5e7, user_id=4c0fe72487114f47ad7944b05d3698b1, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:26.985782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:27.080090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1179/2354] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:26 2022] PUT /identity/v3/projects/7a033c0ad5484ff89949482c587ea5e7/users/4c0fe72487114f47ad7944b05d3698b1/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:27.085301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31613b2-6587-4fc7-9ea4-47d307d4f7e6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:27.085674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31613b2-6587-4fc7-9ea4-47d307d4f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:27.086108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31613b2-6587-4fc7-9ea4-47d307d4f7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:27.130944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c31613b2-6587-4fc7-9ea4-47d307d4f7e6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:27.132202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c31613b2-6587-4fc7-9ea4-47d307d4f7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:27.241103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1176/2355] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:27.254073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:27.256329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:27.345676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145333a-7d02-4982-ae58-2a71777c6859 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:27.350903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:27.354688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:27.354688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:27.354688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:27.372372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:27.384095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:27.408497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1180/2356] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:27.708348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:27.708880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:27.714673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:27.739527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] MFA Rules not processed for user `648c1ba14f1842a5b4160a7569e3206e`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:27.740799 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:27.806074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1177/2357] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:27.810715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:27.812548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:27.827236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a557bc5-463e-4a13-a2c9-110b97649d08 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:27.836022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:27.836022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:27.836022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:27.836022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:27.836485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:27.837383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:27.934480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1181/2358] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:26:27 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:27.937322 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:27.948304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24523b-94e6-4b88-b6bc-17c5f2fb1b2d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:28.009372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:28.010082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:28.010374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:28.010697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:28.011430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:28.013480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:28.121678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:28.132082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1178/2359] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:26:27 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:28.132268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:28.144145 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408236f-f865-419c-bea9-5e2afe9e9d73 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:28.157285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:28.157285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:28.157285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:28.157285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:28.157723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:28.157723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:28.161285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:28.174314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1182/2360] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:28.178571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:28.190872 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4921c07-09c8-4951-957b-336a60690bd0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:28.195817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:28.196720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:28.197001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:28.197300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] PATH_INFO: `/v3/projects/3f51ecfadddc4a11a3c17d68f73a46cb/users/bd72844245aa4739af67c4aa66d7dd6f/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:28.215136 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f51ecfadddc4a11a3c17d68f73a46cb, user_id=bd72844245aa4739af67c4aa66d7dd6f, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:28.218141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:28.297348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1179/2361] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:28 2022] PUT /identity/v3/projects/3f51ecfadddc4a11a3c17d68f73a46cb/users/bd72844245aa4739af67c4aa66d7dd6f/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:26:28.301474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:28.313390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831380eb-fba9-4b68-8648-1b54774a37dd admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:28.376272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314844e0-afc3-4b87-a025-6a32bf0e8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:28.377055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314844e0-afc3-4b87-a025-6a32bf0e8406 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:28.384695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314844e0-afc3-4b87-a025-6a32bf0e8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:28.384695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314844e0-afc3-4b87-a025-6a32bf0e8406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:28.384695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314844e0-afc3-4b87-a025-6a32bf0e8406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:28.384695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314844e0-afc3-4b87-a025-6a32bf0e8406 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:28.393931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1183/2362] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:28.397569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:28.411586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87beba6-4b24-4bf3-b276-387aec0843e2 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:28.416645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:28.419651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:28.419651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:28.419651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] PATH_INFO: `/v3/projects/3f51ecfadddc4a11a3c17d68f73a46cb/users/bd72844245aa4739af67c4aa66d7dd6f/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:28.421169 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f51ecfadddc4a11a3c17d68f73a46cb, user_id=bd72844245aa4739af67c4aa66d7dd6f, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:28.423947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:28.446684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1180/2363] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:28 2022] PUT /identity/v3/projects/3f51ecfadddc4a11a3c17d68f73a46cb/users/bd72844245aa4739af67c4aa66d7dd6f/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:35.686955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:35.687888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:35.688325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:35.751275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] MFA Rules not processed for user `4c0fe72487114f47ad7944b05d3698b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:35.752831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:35.894638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1184/2364] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:35.898946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:35.997090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb7b33-c69e-4038-8635-7a14fc3a3bcf admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:36.011115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:36.012030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:36.012581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:36.017995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:36.019182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:36.021352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:36.149148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1181/2365] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:26:35 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:26:36.150805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:36.176422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cfc4a-3f00-4095-af97-347523835ceb None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:36.361794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:36.361794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:36.361794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:36.361794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:36.362395 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:36.363876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:36.495427 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1185/2366] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:26:36 2022] POST /identity/v3/users => generated 299 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:26:36.496553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:36.511451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb2ed5-33fb-481d-9d26-07a226d9d0fd admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:36.518200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:36.519002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:36.519364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:36.519718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:36.520610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:36.522431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:36.544097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:36.552539 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1182/2367] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:36.556926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14b7f8-4ff2-4cd3-bbef-3322d03b99b3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:36.576950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:36.581086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:36.581086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:36.581086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] PATH_INFO: `/v3/projects/a120ec1a7f29497295175225a74c6754/users/d1d78e31733a4690b76e3307da913487/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:36.599639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:36.606705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a120ec1a7f29497295175225a74c6754, user_id=d1d78e31733a4690b76e3307da913487, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:36.612312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:36.694223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1186/2368] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:36 2022] PUT /identity/v3/projects/a120ec1a7f29497295175225a74c6754/users/d1d78e31733a4690b76e3307da913487/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:26:36.698316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:36.709523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f22fc-a34d-4a04-babc-b1ecd7bd7584 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:36.773228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30618c4b-d0f2-48b0-afac-497dc8a08f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:36.774206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30618c4b-d0f2-48b0-afac-497dc8a08f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:36.774493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30618c4b-d0f2-48b0-afac-497dc8a08f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:36.774773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30618c4b-d0f2-48b0-afac-497dc8a08f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:36.775506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30618c4b-d0f2-48b0-afac-497dc8a08f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:36.777241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30618c4b-d0f2-48b0-afac-497dc8a08f13 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:36.789840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1183/2369] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:26:36.793972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:36.809860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111afbde-0622-43e1-8a1e-907814b05508 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:36.815837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:36.816729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:36.817016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:36.817299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] PATH_INFO: `/v3/projects/a120ec1a7f29497295175225a74c6754/users/d1d78e31733a4690b76e3307da913487/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:36.819415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a120ec1a7f29497295175225a74c6754, user_id=d1d78e31733a4690b76e3307da913487, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:36.822237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:36.841192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1187/2370] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:26:36 2022] PUT /identity/v3/projects/a120ec1a7f29497295175225a74c6754/users/d1d78e31733a4690b76e3307da913487/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:26:37.565510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203589-e37e-43e9-b7b8-0c8be857d6dc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:37.566727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203589-e37e-43e9-b7b8-0c8be857d6dc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:37.567190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203589-e37e-43e9-b7b8-0c8be857d6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:37.611812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6b203589-e37e-43e9-b7b8-0c8be857d6dc None None] MFA Rules not processed for user `bd72844245aa4739af67c4aa66d7dd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:37.613795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6b203589-e37e-43e9-b7b8-0c8be857d6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:37.647129 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:37.829416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1184/2371] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:37.847024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:37.849542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:38.071045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68515-b50a-479c-89a0-be8cd9232847 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:38.092974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:38.101356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:38.101677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:38.102020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:38.218332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:38.222248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:38.251435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1188/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:45.715383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab8fe-91de-4b3f-a9a0-6cf909b4278c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:45.715885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab8fe-91de-4b3f-a9a0-6cf909b4278c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:45.715983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab8fe-91de-4b3f-a9a0-6cf909b4278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:45.752794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8c8ab8fe-91de-4b3f-a9a0-6cf909b4278c None None] MFA Rules not processed for user `d1d78e31733a4690b76e3307da913487`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:45.754370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8c8ab8fe-91de-4b3f-a9a0-6cf909b4278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:45.851694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1185/2373] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:45.859865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:45.862144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:45.952094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:45.992833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bc0bb-73c4-4641-babe-aa079375223a service nova] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:45.998720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:45.999489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:45.999837 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:46.000449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:46.074312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:46.077506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:46.089933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1189/2374] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:26:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:26:46.383302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e9aac-7e7c-4e44-8f98-08edf4284889 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:46.383598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e9aac-7e7c-4e44-8f98-08edf4284889 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:46.383883 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e9aac-7e7c-4e44-8f98-08edf4284889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:46.464954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f20e9aac-7e7c-4e44-8f98-08edf4284889 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:46.467419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f20e9aac-7e7c-4e44-8f98-08edf4284889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:46.562037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1186/2375] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:46.729192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:26:46.734192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:46.864467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7d185-1c79-4f5b-8ce4-3900a0c978ff service glance] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:26:46.869718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c1d14-d512-45a3-8e42-a777019abf56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:26:46.870429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1d14-d512-45a3-8e42-a777019abf56 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:46.870713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1d14-d512-45a3-8e42-a777019abf56 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:46.870988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1d14-d512-45a3-8e42-a777019abf56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:46.880152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c1d14-d512-45a3-8e42-a777019abf56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:26:46.881752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c1d14-d512-45a3-8e42-a777019abf56 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:26:46.890289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1190/2376] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:26:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:26:55.989974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39f47-f5b7-4799-8a1b-c0beef7b69a2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:55.990616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39f47-f5b7-4799-8a1b-c0beef7b69a2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:55.990616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b39f47-f5b7-4799-8a1b-c0beef7b69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:56.015168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:56.028260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-01b39f47-f5b7-4799-8a1b-c0beef7b69a2 None None] MFA Rules not processed for user `787efd65008840748e98f9e46e11a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:56.030476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-01b39f47-f5b7-4799-8a1b-c0beef7b69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:56.114527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1187/2377] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:26:56.886682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=77 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:26:59.508956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:26:59.509564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:26:59.509678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:26:59.530525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] MFA Rules not processed for user `4c0fe72487114f47ad7944b05d3698b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:26:59.532690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:26:59.540532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1191/2378] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:26:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:06.115689 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=22 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:07.987458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b324c-4088-405b-99a9-273f9b9c5557 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:07.988131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b324c-4088-405b-99a9-273f9b9c5557 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:07.988131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b324c-4088-405b-99a9-273f9b9c5557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:08.022227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-dc1b324c-4088-405b-99a9-273f9b9c5557 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:08.023468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-dc1b324c-4088-405b-99a9-273f9b9c5557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:08.047547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1188/2379] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:27:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:08.061562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:08.080341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ebf7f-7434-4eb7-a0d7-4e76193e3c5e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:08.109163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febb0ca-a84f-468d-84da-2e4a0683c9cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:08.109163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febb0ca-a84f-468d-84da-2e4a0683c9cf service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:08.109163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febb0ca-a84f-468d-84da-2e4a0683c9cf service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:08.109163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febb0ca-a84f-468d-84da-2e4a0683c9cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:08.137839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febb0ca-a84f-468d-84da-2e4a0683c9cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:08.144655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febb0ca-a84f-468d-84da-2e4a0683c9cf service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:08.185236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1192/2380] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:27:08.893437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57325c8-3a80-4e47-8372-f074145f3422 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:08.893734 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57325c8-3a80-4e47-8372-f074145f3422 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:08.894047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57325c8-3a80-4e47-8372-f074145f3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:08.922515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b57325c8-3a80-4e47-8372-f074145f3422 None None] MFA Rules not processed for user `648c1ba14f1842a5b4160a7569e3206e`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:08.924427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b57325c8-3a80-4e47-8372-f074145f3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:08.932973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1189/2381] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:18.165649 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=9 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:18.911612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=6 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:36.286654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:36.287168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:36.287290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:36.304744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] MFA Rules not processed for user `7c5ef23fbdb145bfa485859ff4c43b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:36.307292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:36.365839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1193/2382] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:45.581717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:45.582821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:45.583190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:45.602690 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] MFA Rules not processed for user `41eb98b3a8434e7e9734eb747047a87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:27:45.603901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:45.668246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1190/2383] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:27:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:27:46.358206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=25 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:27:47.803376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:47.804795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:47.862857 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16042ca6-eaeb-4318-9fd1-0e53c3bfb525 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:47.866379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:47.867031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:47.867315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:47.867596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:47.877436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:47.879058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:47.888859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1194/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:27:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:27:50.147435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:50.161642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccafbc-67dd-40d5-b8f3-f688ee43e654 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:50.166054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:50.167303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:50.167303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:50.167303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:50.169550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:50.185716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:50.187612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:50.201696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1191/2385] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:27:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:27:52.842966 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:52.853263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b1dfb-dc0b-4426-955e-ea18c7d32d16 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:52.858036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b298d6-3fd1-4832-8970-268547525fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:52.858785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b298d6-3fd1-4832-8970-268547525fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:52.859189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b298d6-3fd1-4832-8970-268547525fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:52.859571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b298d6-3fd1-4832-8970-268547525fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:52.870673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b298d6-3fd1-4832-8970-268547525fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:52.874504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b298d6-3fd1-4832-8970-268547525fdc service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:52.882339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1195/2386] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:27:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:27:53.900819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:27:53.911118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d808c-8e13-416c-b068-58d02503d5b9 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:27:53.914986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:27:53.915639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:27:53.915979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:27:53.916262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:27:53.919063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:27:53.933257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:27:53.934821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:27:53.947325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1192/2387] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:27:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:28:00.304039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:00.304551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:00.304675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:00.322602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] MFA Rules not processed for user `ec4c5293e6a148a2a16ba4c3fc57a3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:00.323826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:00.380019 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1196/2388] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:28:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:28:03.474526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:03.485440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9d1d4-bf2b-4728-821a-7013767b5573 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:03.491156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:03.491788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:03.492068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:03.492341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:03.494209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:03.504855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:03.506508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:03.515518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1193/2389] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:09.163137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:09.172944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82287e22-13c5-4033-abd9-b2349ff39b9e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:09.177714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:09.178385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:09.178672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:09.178950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:09.180893 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:09.192674 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:09.194221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:09.203574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1197/2390] 10.222.0.64 () {60 vars in 1396 bytes} [Mon Jun 20 12:28:09 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:13.511397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=43 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:19.199132 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=63 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:28.040461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:28.050171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2efcd8-ee39-45e3-a579-9dfcb395b572 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:28.053836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:28.054486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:28.054772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:28.055055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:28.056831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:28.067361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:28.068815 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:28.077329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1194/2391] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:32.280309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:32.294023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b3037-df2a-4b74-9225-09d6a339bc35 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:32.300117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:32.300750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:32.301031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:32.301308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:32.303059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:32.313210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:32.315923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:32.326779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1198/2392] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:38.073530 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=6 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:42.322493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=6 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:49.084894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.084894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:49.161379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f46d-f0c6-4944-863d-e75554670055 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.166555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.167448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.167760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.168049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] PATH_INFO: `/v3/users/7c5ef23fbdb145bfa485859ff4c43b4c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.169285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c5ef23fbdb145bfa485859ff4c43b4c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.171545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:49.423450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c5ef23fbdb145bfa485859ff4c43b4c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.440728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c5ef23fbdb145bfa485859ff4c43b4c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.516792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c5ef23fbdb145bfa485859ff4c43b4c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.517362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c5ef23fbdb145bfa485859ff4c43b4c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.525337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c5ef23fbdb145bfa485859ff4c43b4c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:49.531812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1195/2393] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:28:49 2022] DELETE /identity/v3/users/7c5ef23fbdb145bfa485859ff4c43b4c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:49.849295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:49.860631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279c135-d390-4b37-b5a4-a8ef1565b977 service nova] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:49.931521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:49.932415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:49.932695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:49.933021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] PATH_INFO: `/v3/projects/d9b0e8111c084f769bbc267365364900` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:49.934320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b0e8111c084f769bbc267365364900)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:49.936283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:50.061252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b0e8111c084f769bbc267365364900', 'request_id': 'req-e81ff108-f126-48ce-aba5-53d7512444b9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:50.068233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b0e8111c084f769bbc267365364900', 'request_id': 'req-e81ff108-f126-48ce-aba5-53d7512444b9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:50.074650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b0e8111c084f769bbc267365364900', 'request_id': 'req-e81ff108-f126-48ce-aba5-53d7512444b9'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:50.222229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] The token cache is being invalidate because project d9b0e8111c084f769bbc267365364900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:28:50.222566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:50.223212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e81ff108-f126-48ce-aba5-53d7512444b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:28:50.224766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1199/2394] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:28:49 2022] DELETE /identity/v3/projects/d9b0e8111c084f769bbc267365364900 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:28:50.693906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:50.695305 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:50.774749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda87ff-ef94-4685-b852-f640cc0b207a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:50.788353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:50.843966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:50.844635 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:50.845091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:50.845220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:50.847512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:50.863432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:50.865604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:50.876954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1196/2395] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:57.422161 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.422657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.422755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.441292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] MFA Rules not processed for user `787efd65008840748e98f9e46e11a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:28:57.442524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.495685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1200/2396] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:28:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:28:57.807982 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:57.809367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.869287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c64dc9-8a4a-4718-808b-074185ad34eb service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:57.872896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:57.873538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:57.873843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:57.874128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:57.876026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:57.886354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:57.887953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:57.896431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1197/2397] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:28:58.304375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:28:58.306025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.349387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:28:58.379050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789aec0-70f5-474c-8e12-8b0892fb548e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:28:58.383652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:28:58.384349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:28:58.384665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:28:58.384934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:28:58.386790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:28:58.399624 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:28:58.401292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd7ef6-da0e-4163-ab2d-cefafde22107 service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:28:58.412062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1201/2398] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:28:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:07.892427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=52 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:08.562420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=16 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:09.335742 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.337225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.353505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358f75-5b64-4724-9359-d256b7d71def service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.359010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.359650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.359934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.360215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.362053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.374089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.375709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29a3b4-9bda-49c9-af07-9af72262d31d service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.387296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1198/2399] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:09.904193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05643-5c3d-4e7e-99c6-ba8889b9609d None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.904733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05643-5c3d-4e7e-99c6-ba8889b9609d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.904733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a05643-5c3d-4e7e-99c6-ba8889b9609d None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.906418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1202/2400] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:29:09.914807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d810a-a36a-49d5-a913-78633e5a8438 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.914807 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d810a-a36a-49d5-a913-78633e5a8438 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.915236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d810a-a36a-49d5-a913-78633e5a8438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.938328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f84d810a-a36a-49d5-a913-78633e5a8438 None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:09.939531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f84d810a-a36a-49d5-a913-78633e5a8438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.947146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1199/2401] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:29:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:09.959585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05643-5c3d-4e7e-99c6-ba8889b9609d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:09.961565 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-04a05643-5c3d-4e7e-99c6-ba8889b9609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:09.975152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a05643-5c3d-4e7e-99c6-ba8889b9609d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:09.978804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215580-1663-466d-b2a2-71e71c416034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:09.979431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215580-1663-466d-b2a2-71e71c416034 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:09.979735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215580-1663-466d-b2a2-71e71c416034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:09.980012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215580-1663-466d-b2a2-71e71c416034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:09.988973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db215580-1663-466d-b2a2-71e71c416034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:09.990479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db215580-1663-466d-b2a2-71e71c416034 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:09.998953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1203/2402] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:10.094480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898c33-d209-49ae-a074-d60317da69a1 None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.094773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898c33-d209-49ae-a074-d60317da69a1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.095083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898c33-d209-49ae-a074-d60317da69a1 None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.097167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1200/2403] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:29:10.102930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.103227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.103568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.156660 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:10.157962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:10.168814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1204/2404] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:29:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:10.180054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898c33-d209-49ae-a074-d60317da69a1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:10.191710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898c33-d209-49ae-a074-d60317da69a1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:10.196051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:10.196051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:10.196272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:10.196527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:10.207651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:10.209108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:10.220246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1201/2405] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:20.153515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=15 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:20.215719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=15 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:31.678611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:31.688064 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b980bd-3cfc-4518-a0b2-ebf793f30fd4 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:31.691872 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:31.692521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:31.693338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:31.693338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:31.695050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:31.759749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:31.761213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:31.772913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1205/2406] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:35.858591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:35.871003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17659d-ba0b-4404-80de-5f796d2cb703 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:35.876292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:35.877146 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:35.877431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:35.877707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:35.880511 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:35.892532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:35.894642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:35.906421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1202/2407] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:36.076751 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:36.078863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:36.095923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd09ea-d39a-401c-9a13-7abe3ae7bcc8 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:36.103203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:36.105890 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:36.106443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:36.107079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] PATH_INFO: `/v3/users/ec4c5293e6a148a2a16ba4c3fc57a3a3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:36.109849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4c5293e6a148a2a16ba4c3fc57a3a3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:36.112846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:36.333253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4c5293e6a148a2a16ba4c3fc57a3a3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:36.347745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4c5293e6a148a2a16ba4c3fc57a3a3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:36.355316 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4c5293e6a148a2a16ba4c3fc57a3a3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:36.356154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4c5293e6a148a2a16ba4c3fc57a3a3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:36.356771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-bbbc49b0-2c21-49f3-b8c2-629f1301060c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4c5293e6a148a2a16ba4c3fc57a3a3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:36.447120 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1206/2408] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:36 2022] DELETE /identity/v3/users/ec4c5293e6a148a2a16ba4c3fc57a3a3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:36.713840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:36.731992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7654cea-fa2f-4008-b19b-66497afee243 service placement] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:36.798148 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:36.799016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:36.799344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:36.799649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] PATH_INFO: `/v3/projects/d55e2a4f35944f65bb0d5b1382b8cafc` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:36.801651 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55e2a4f35944f65bb0d5b1382b8cafc)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:36.803594 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:36.952756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'request_id': 'req-7906908e-e124-45a5-9a4c-c84a0eaec9c5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:37.043228 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'request_id': 'req-7906908e-e124-45a5-9a4c-c84a0eaec9c5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:37.052566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55e2a4f35944f65bb0d5b1382b8cafc', 'request_id': 'req-7906908e-e124-45a5-9a4c-c84a0eaec9c5'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:37.084869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] The token cache is being invalidate because project d55e2a4f35944f65bb0d5b1382b8cafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:37.086002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:37.086452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-7906908e-e124-45a5-9a4c-c84a0eaec9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:37.091279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1203/2409] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:36 2022] DELETE /identity/v3/projects/d55e2a4f35944f65bb0d5b1382b8cafc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:37.094350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.095170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.095461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.118924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:37.120169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:37.194792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1207/2410] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:37.203022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.203627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.204086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.227107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:37.229105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:37.238479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1204/2411] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:37.243020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.258885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f42fa-2b3c-41a2-b646-d8ee6436c9c1 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.264708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.265894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.266225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.266516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.271806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:37.271806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.271806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:37.272919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:37.288256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1208/2412] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:37.298729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.310320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab6b6c-a977-4969-99e6-325d4f30d514 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.317884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.319029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.319369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.319752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.320704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.323222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:37.481654 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1205/2413] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:37 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:37.482758 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.494636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c6c8-b12e-41d2-a0fa-6ace34274902 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.574094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.575013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.575319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.575761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.576652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.579227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:37.678638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1209/2414] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:37 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:29:37.682728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.693433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616ace-fc9f-43e7-88a9-301027194e1e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.698208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.698868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.699152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.699571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.700307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.701931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:37.712451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1206/2415] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:37.722293 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.732406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfbf33-3f17-4236-9c77-078003a91be6 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.737343 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a2a80-6632-40c9-93c2-b41f92b42657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.738701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2a80-6632-40c9-93c2-b41f92b42657 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.739125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2a80-6632-40c9-93c2-b41f92b42657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.739418 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a2a80-6632-40c9-93c2-b41f92b42657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.740150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2a80-6632-40c9-93c2-b41f92b42657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.741788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a2a80-6632-40c9-93c2-b41f92b42657 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:37.752217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1210/2416] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:37.762260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:37.772825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b8124-8edf-40e3-82a1-0c72f35c6df5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:37.777458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:37.778374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.778657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.778933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] PATH_INFO: `/v3/projects/882feee6f30d4e52b8ab28f7e7193568/users/65f0d59c17874c949670e0e81c5b74f4/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.796222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882feee6f30d4e52b8ab28f7e7193568, user_id=65f0d59c17874c949670e0e81c5b74f4, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:37.799421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:37.895719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1207/2417] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:37 2022] PUT /identity/v3/projects/882feee6f30d4e52b8ab28f7e7193568/users/65f0d59c17874c949670e0e81c5b74f4/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:37.901022 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cea31-e000-41f3-a8af-b43fbcfc8dc6 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:37.901313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cea31-e000-41f3-a8af-b43fbcfc8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:37.901591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cea31-e000-41f3-a8af-b43fbcfc8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:37.920412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-415cea31-e000-41f3-a8af-b43fbcfc8dc6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:37.921772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-415cea31-e000-41f3-a8af-b43fbcfc8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:37.991860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1211/2418] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:38.001945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:38.006153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:38.017919 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:38.077823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ff0f1-5faf-447e-8544-2bcda71352b7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:38.077823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:38.077823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:38.077823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:38.078823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:38.082775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:38.084259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:38.094321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1208/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:39.994668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:39.995329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:39.995444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:40.016421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:40.017780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:40.099547 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1212/2420] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jun 20 12:29:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:40.160853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:40.162833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:40.242684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17179a6-ea1d-4fff-8780-bfa59720cd04 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:40.247757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa551c-1306-4f3a-9dfb-192d58cf0f19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:40.248468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa551c-1306-4f3a-9dfb-192d58cf0f19 service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:40.248821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa551c-1306-4f3a-9dfb-192d58cf0f19 service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:40.249109 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa551c-1306-4f3a-9dfb-192d58cf0f19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:40.258219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa551c-1306-4f3a-9dfb-192d58cf0f19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:40.259990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa551c-1306-4f3a-9dfb-192d58cf0f19 service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:40.269261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1209/2421] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:29:43.448389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:43.451221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:43.470646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117cd5-3f1c-4925-bac2-dba8947d5206 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:43.476640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:43.477542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:43.478290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:43.478721 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:43.480798 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:43.500983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:43.500983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:43.514710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1213/2422] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:44.273694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:44.274252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:44.274252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:44.337650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] MFA Rules not processed for user `65f0d59c17874c949670e0e81c5b74f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:44.339468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:44.460993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1210/2423] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:44.478736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:44.480318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:44.490802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:44.619799 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44fa34-5638-40ba-b9f2-da894378450a service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:44.627241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a56ac-ddc8-4f25-abff-5b8e285f26d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:44.628787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a56ac-ddc8-4f25-abff-5b8e285f26d7 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:44.629503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a56ac-ddc8-4f25-abff-5b8e285f26d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:44.630126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a56ac-ddc8-4f25-abff-5b8e285f26d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:44.643275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a56ac-ddc8-4f25-abff-5b8e285f26d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:44.647324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a56ac-ddc8-4f25-abff-5b8e285f26d7 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:44.658557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1214/2424] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:48.224452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:48.226964 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:48.290320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:48.342015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686034a6-2fce-414e-a0af-a5e1f4ea2d23 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:48.350286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:48.350965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:48.351362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:48.351517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:48.353907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:48.368264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:48.370192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:48.382612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1211/2425] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:48.844657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:48.845234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:48.845234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:48.876932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] MFA Rules not processed for user `65f0d59c17874c949670e0e81c5b74f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:48.878957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:48.891630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1215/2426] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:49.476153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:49.486630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed0ed1-6dd6-45f6-866a-ceaa7de6d9bb service placement] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:49.491273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:49.491999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:49.492435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:49.493037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:49.495019 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:49.516759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:49.516759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:49.517427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1212/2427] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:49.556783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:49.558503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:49.585575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f6781-ffc2-47ec-bc22-17f59cf529f3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:49.594360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:49.598341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:49.598780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:49.599037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] PATH_INFO: `/v3/users/41eb98b3a8434e7e9734eb747047a87d` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:49.600698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41eb98b3a8434e7e9734eb747047a87d)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:49.603321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:49.897852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41eb98b3a8434e7e9734eb747047a87d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.923275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41eb98b3a8434e7e9734eb747047a87d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.944013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41eb98b3a8434e7e9734eb747047a87d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.946219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41eb98b3a8434e7e9734eb747047a87d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:49.949957 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b88c3359-938d-4500-8f7c-d98a7de25718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41eb98b3a8434e7e9734eb747047a87d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:50.032774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1216/2428] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:49 2022] DELETE /identity/v3/users/41eb98b3a8434e7e9734eb747047a87d => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:50.444684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:50.458854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d46771-3e88-4a1e-864b-63e2e95a36c6 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:50.537115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:50.538206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:50.538501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:50.538782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] PATH_INFO: `/v3/projects/3c7566543a6145b7b1a01612aff1c02a` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:50.540258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7566543a6145b7b1a01612aff1c02a)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:50.542239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:50.672945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7566543a6145b7b1a01612aff1c02a', 'request_id': 'req-bfa851f1-1bff-489b-9be3-2daa736d0b9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:50.757350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7566543a6145b7b1a01612aff1c02a', 'request_id': 'req-bfa851f1-1bff-489b-9be3-2daa736d0b9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:50.764258 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7566543a6145b7b1a01612aff1c02a', 'request_id': 'req-bfa851f1-1bff-489b-9be3-2daa736d0b9b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:50.777928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] The token cache is being invalidate because project 3c7566543a6145b7b1a01612aff1c02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:50.778314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:50.779055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-bfa851f1-1bff-489b-9be3-2daa736d0b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:50.780708 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1213/2429] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:50 2022] DELETE /identity/v3/projects/3c7566543a6145b7b1a01612aff1c02a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:50.786110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:50.786515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:50.786897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:50.807720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:50.809081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:50.869717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:50.884888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1217/2430] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:50.893093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:50.893710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:50.894022 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:50.921772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:50.924548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:50.932419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1214/2431] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:50.936801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:50.947712 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47c640-8221-4e4d-9fda-f6c39074d631 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:50.953650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:50.954417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:50.954704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:50.954983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:50.955813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:50.956783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:50.959188 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:50.976579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1218/2432] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:50.980528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:50.994089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f047a1-57ff-402f-8c1b-da45c834f611 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:50.999733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:51.001219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.002068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.002591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.004212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:51.006600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:51.169927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1215/2433] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:50 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:51.172292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:51.184517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d38d8-bc8f-4b89-a8f4-d2cd7d957669 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:51.280954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:51.281639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.281964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.282259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.283196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:51.286012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:51.416973 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1219/2434] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:51 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:51.421179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:51.430024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:51.433904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615380b-cf9d-422f-ad24-f1cf567e6f59 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:51.438879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:51.439552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.441433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.441433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.441433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:51.442751 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:51.454132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1216/2435] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:51.458461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:51.469933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa34fcf-ba08-431a-a187-6e86c4a2baba admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:51.475941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5e5f5-7a70-4753-9868-250b0c42429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:51.476636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e5f5-7a70-4753-9868-250b0c42429a admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.476928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e5f5-7a70-4753-9868-250b0c42429a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.477213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5e5f5-7a70-4753-9868-250b0c42429a admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.477991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5e5f5-7a70-4753-9868-250b0c42429a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:51.479639 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5e5f5-7a70-4753-9868-250b0c42429a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:51.491122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1220/2436] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:29:51.495440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:51.506450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914063d0-a8c7-4a9c-b7c1-92426a694d44 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:51.513067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:51.514598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.515080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.515559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] PATH_INFO: `/v3/projects/57e0b7ebea1240a69f600c2828b732fb/users/79edabc69ad14bc48685dc297c38b943/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.546994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e0b7ebea1240a69f600c2828b732fb, user_id=79edabc69ad14bc48685dc297c38b943, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:51.549777 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:51.689316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1217/2437] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:51 2022] PUT /identity/v3/projects/57e0b7ebea1240a69f600c2828b732fb/users/79edabc69ad14bc48685dc297c38b943/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:51.701770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.702085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.702368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.733263 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] MFA Rules not processed for user `79edabc69ad14bc48685dc297c38b943`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:51.734761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:51.814687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1221/2438] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:29:51.826624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:51.828811 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:51.912447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6997cc-8e65-411c-a5c0-4689e0f67ff9 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:51.922155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:51.922285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:51.922613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:51.922889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:51.933445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:51.935185 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:51.957249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1218/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:52.890262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:52.892397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:52.978897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:53.009012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d0075-19b4-4195-8311-a69e551b20da None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:53.016419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:53.017871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:53.019125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:53.019713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] PATH_INFO: `/v3/users/4c0fe72487114f47ad7944b05d3698b1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:53.022820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0fe72487114f47ad7944b05d3698b1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:53.026689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:53.298638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0fe72487114f47ad7944b05d3698b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:53.313702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0fe72487114f47ad7944b05d3698b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:53.321681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0fe72487114f47ad7944b05d3698b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:53.322615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0fe72487114f47ad7944b05d3698b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:53.323232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0fe72487114f47ad7944b05d3698b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:53.432300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1222/2440] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:52 2022] DELETE /identity/v3/users/4c0fe72487114f47ad7944b05d3698b1 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:53.707399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:53.718489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64011ec7-f613-4aa5-966b-5def921a4b3a service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:53.785550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:53.786451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:53.786735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:53.787009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] PATH_INFO: `/v3/projects/7a033c0ad5484ff89949482c587ea5e7` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:53.788239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a033c0ad5484ff89949482c587ea5e7)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:53.790443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:53.993112 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a033c0ad5484ff89949482c587ea5e7', 'request_id': 'req-1ce506c5-fd33-4cc7-900b-2da141de92e3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.100535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a033c0ad5484ff89949482c587ea5e7', 'request_id': 'req-1ce506c5-fd33-4cc7-900b-2da141de92e3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.103785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.108940 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a033c0ad5484ff89949482c587ea5e7', 'request_id': 'req-1ce506c5-fd33-4cc7-900b-2da141de92e3'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.120343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] The token cache is being invalidate because project 7a033c0ad5484ff89949482c587ea5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:54.120712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.121359 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.122962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1219/2441] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:53 2022] DELETE /identity/v3/projects/7a033c0ad5484ff89949482c587ea5e7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:54.126980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:54.128908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:54.149016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a07ee1-02ec-499a-9a28-812a73211909 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:54.236289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:54.240227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:54.240683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:54.241176 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] PATH_INFO: `/v3/users/d1d78e31733a4690b76e3307da913487` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:54.242979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d78e31733a4690b76e3307da913487)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:54.245374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:54.516108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d78e31733a4690b76e3307da913487'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.543245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d78e31733a4690b76e3307da913487'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.561734 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:54.564724 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d78e31733a4690b76e3307da913487'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.565516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d78e31733a4690b76e3307da913487'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.566938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d78e31733a4690b76e3307da913487'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:54.656196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1223/2442] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:54 2022] DELETE /identity/v3/users/d1d78e31733a4690b76e3307da913487 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:54.924684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:54.927213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:54.945632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce506c5-fd33-4cc7-900b-2da141de92e3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:55.045203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:55.046341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:55.046721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:55.047091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] PATH_INFO: `/v3/projects/a120ec1a7f29497295175225a74c6754` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:55.048517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a120ec1a7f29497295175225a74c6754)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:55.051389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:55.185412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a120ec1a7f29497295175225a74c6754', 'request_id': 'req-5a83b402-3ef0-4e53-bad9-b6ade5f24809'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:55.282699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a120ec1a7f29497295175225a74c6754', 'request_id': 'req-5a83b402-3ef0-4e53-bad9-b6ade5f24809'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:55.293058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a120ec1a7f29497295175225a74c6754', 'request_id': 'req-5a83b402-3ef0-4e53-bad9-b6ade5f24809'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:55.317772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] The token cache is being invalidate because project a120ec1a7f29497295175225a74c6754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:55.318481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:55.319482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5a83b402-3ef0-4e53-bad9-b6ade5f24809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:55.321733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1220/2443] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:54 2022] DELETE /identity/v3/projects/a120ec1a7f29497295175225a74c6754 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:55.692638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:55.692638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:55.712002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30580251-a8a0-4650-9b97-867b63ccc294 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:55.788558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:55.790293 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:55.790627 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:55.790941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] PATH_INFO: `/v3/users/79edabc69ad14bc48685dc297c38b943` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:55.792182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79edabc69ad14bc48685dc297c38b943)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:55.794216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:56.109500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79edabc69ad14bc48685dc297c38b943'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:56.123264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79edabc69ad14bc48685dc297c38b943'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:56.131043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79edabc69ad14bc48685dc297c38b943'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:56.131745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79edabc69ad14bc48685dc297c38b943'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:56.132345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79edabc69ad14bc48685dc297c38b943'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:56.455779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1224/2444] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:55 2022] DELETE /identity/v3/users/79edabc69ad14bc48685dc297c38b943 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:56.460300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:56.460763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:56.461748 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:56.479378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:56.480592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:56.540126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1221/2445] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:56.550523 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:56.553666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:56.617879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7320614-cd93-422f-9068-be99327dee44 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:56.621426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8401a7-9611-45f5-a57e-f48c35a4d821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:56.622099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8401a7-9611-45f5-a57e-f48c35a4d821 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:56.622382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8401a7-9611-45f5-a57e-f48c35a4d821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:56.622656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8401a7-9611-45f5-a57e-f48c35a4d821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:56.632126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8401a7-9611-45f5-a57e-f48c35a4d821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:56.633560 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8401a7-9611-45f5-a57e-f48c35a4d821 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:56.642804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1225/2446] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:57.313329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:57.314838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:57.330334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a24018-666b-4aa7-8bc1-88a876598718 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:57.336020 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:57.336898 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:57.337223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:57.337480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] PATH_INFO: `/v3/projects/57e0b7ebea1240a69f600c2828b732fb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:57.338721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e0b7ebea1240a69f600c2828b732fb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:57.345154 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:57.352833 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:57.462321 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e0b7ebea1240a69f600c2828b732fb', 'request_id': 'req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:57.557261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e0b7ebea1240a69f600c2828b732fb', 'request_id': 'req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:57.564578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e0b7ebea1240a69f600c2828b732fb', 'request_id': 'req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:57.576830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] The token cache is being invalidate because project 57e0b7ebea1240a69f600c2828b732fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:29:57.577121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:57.577766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5e406f3c-a0cf-47ca-b4c7-38c6c780dd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:57.579392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1222/2447] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:57 2022] DELETE /identity/v3/projects/57e0b7ebea1240a69f600c2828b732fb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:57.584462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:57.584932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:57.585054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:57.602438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:57.603651 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:57.609421 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:57.671919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1226/2448] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:57.680573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:57.680962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:57.681216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:57.701056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:57.702314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:57.711091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1223/2449] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:57.715310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:57.725449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3738263-58f7-4acd-bddc-0b3bb07f3806 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:57.730410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:57.731105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:57.731394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:57.734873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:57.734873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:29:57.734873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:57.734873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:57.746718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1227/2450] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:29:57.751032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:57.768375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeab81a-9051-4118-8a7a-fe56d4dfbb8f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:57.768375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:57.768375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:57.768375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:57.768805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:57.768805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:57.769791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:57.936461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1224/2451] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:57.940771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:57.950856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51037edc-d3b0-4f4d-b45c-150415cc4982 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:58.010869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:58.011538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.011821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.012096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.012794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:58.014774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:58.106716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1228/2452] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:29:57 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:29:58.111626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:58.125425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fe332-a2b8-41f7-9e08-aec2c0881340 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:58.130618 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:58.131273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.131554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.131829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.132554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:58.134186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:58.149756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1225/2453] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:58.150794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:58.162844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967ebd-4127-4a00-9d31-83a85f2bb48e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:58.167933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9b305-afca-493e-884b-f45cf096d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:58.168594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b305-afca-493e-884b-f45cf096d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.168876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b305-afca-493e-884b-f45cf096d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.169169 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9b305-afca-493e-884b-f45cf096d1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.169906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b305-afca-493e-884b-f45cf096d1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:58.171493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9b305-afca-493e-884b-f45cf096d1f7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:58.185996 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1229/2454] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:29:58.187949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:58.199503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd82b47-e2a1-4b52-a90f-42e1da7b8e0e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:58.204568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:58.205460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.205745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.206070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] PATH_INFO: `/v3/projects/0d03ac1cd2274db5a91fecbd4d1023e9/users/249d5bbb105947d5b2e3ff7b1ccab4c2/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.226220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d03ac1cd2274db5a91fecbd4d1023e9, user_id=249d5bbb105947d5b2e3ff7b1ccab4c2, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:58.228992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:58.335424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1226/2455] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:29:58 2022] PUT /identity/v3/projects/0d03ac1cd2274db5a91fecbd4d1023e9/users/249d5bbb105947d5b2e3ff7b1ccab4c2/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:58.345683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.346050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.346360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.373771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] MFA Rules not processed for user `249d5bbb105947d5b2e3ff7b1ccab4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:58.375035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:58.439732 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1230/2456] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:58.451727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:58.453473 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:58.525451 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2e37b-21b4-4c5b-8f25-ac5df47cb0a7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:58.530992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e82684-7418-46cb-8d43-27a41d57ba88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:58.531641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e82684-7418-46cb-8d43-27a41d57ba88 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.531928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e82684-7418-46cb-8d43-27a41d57ba88 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.532210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e82684-7418-46cb-8d43-27a41d57ba88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.541013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e82684-7418-46cb-8d43-27a41d57ba88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:58.542652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e82684-7418-46cb-8d43-27a41d57ba88 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:58.551458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1227/2457] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:58.764666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:58.776388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:58.830726 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c31187-f293-45c1-b7fd-0bbc75e26c53 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:58.836056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:58.837251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:58.837546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:58.837852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] PATH_INFO: `/v3/users/249d5bbb105947d5b2e3ff7b1ccab4c2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:58.839104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249d5bbb105947d5b2e3ff7b1ccab4c2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:58.840997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:59.023374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249d5bbb105947d5b2e3ff7b1ccab4c2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:59.037854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249d5bbb105947d5b2e3ff7b1ccab4c2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:59.045043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249d5bbb105947d5b2e3ff7b1ccab4c2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:59.045742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249d5bbb105947d5b2e3ff7b1ccab4c2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:59.046385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249d5bbb105947d5b2e3ff7b1ccab4c2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:29:59.111243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1231/2458] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:29:58 2022] DELETE /identity/v3/users/249d5bbb105947d5b2e3ff7b1ccab4c2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:29:59.116550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:59.116911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:59.117196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:59.134680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:29:59.135889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:59.148310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:29:59.197548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1228/2459] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:29:59.207947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:59.209385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:59.271237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03489c27-89d0-451d-bfe6-79c841650b63 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:59.274999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b4b4a-176c-43be-ac79-686e8d4335ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:59.275705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b4b4a-176c-43be-ac79-686e8d4335ed service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:59.279671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b4b4a-176c-43be-ac79-686e8d4335ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:59.279671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b4b4a-176c-43be-ac79-686e8d4335ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:59.286078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b4b4a-176c-43be-ac79-686e8d4335ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:59.287606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b4b4a-176c-43be-ac79-686e8d4335ed service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:59.297862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1232/2460] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:29:59.787358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:29:59.788819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:29:59.801852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ca4e3-904e-469b-979c-710a1d17d3c2 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:29:59.806603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:29:59.807757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:29:59.808204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:29:59.808485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] PATH_INFO: `/v3/projects/0d03ac1cd2274db5a91fecbd4d1023e9` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:29:59.809714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d03ac1cd2274db5a91fecbd4d1023e9)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:29:59.811676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:29:59.929285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d03ac1cd2274db5a91fecbd4d1023e9', 'request_id': 'req-b3438b02-8024-4901-8f6d-d391d70c7699'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.025486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d03ac1cd2274db5a91fecbd4d1023e9', 'request_id': 'req-b3438b02-8024-4901-8f6d-d391d70c7699'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.031490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d03ac1cd2274db5a91fecbd4d1023e9', 'request_id': 'req-b3438b02-8024-4901-8f6d-d391d70c7699'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.043923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] The token cache is being invalidate because project 0d03ac1cd2274db5a91fecbd4d1023e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:00.044216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.044851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b3438b02-8024-4901-8f6d-d391d70c7699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:00.046427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1229/2461] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:29:59 2022] DELETE /identity/v3/projects/0d03ac1cd2274db5a91fecbd4d1023e9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:00.051631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.052093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.052186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.070069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:00.071326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:00.097438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:00.133006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1233/2462] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:00.141973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.142263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.142543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.162677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:00.163887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:00.172117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1230/2463] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:00.176555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.186747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea004bb-cc87-4cfd-8ea5-8968c862b558 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.192059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.192817 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.193185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.193472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.194308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:00.194543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.196164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.208915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1234/2464] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:00.213372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.222937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab046a-e4fe-4937-9c18-e4630ce77ef5 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.227672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.228320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.228604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.228880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.229578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.231531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.347836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1231/2465] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:00.351858 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.363415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8436b6-55e1-46c9-9afe-bd314ca06181 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.421504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.422227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.422507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.422782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.423465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.425403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.583800 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1235/2466] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:00.585201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.595976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cd7c7-62b7-4ede-8d0e-c78f14a841a4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.601009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.601645 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.602090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.602378 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.603115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.604729 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.617377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1232/2467] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:00.627571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.638638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52501a29-563f-4795-ab0d-a3793c3a8b39 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.643255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c816fda-0f62-449d-9f02-86ed558d6ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.644195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c816fda-0f62-449d-9f02-86ed558d6ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.644655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c816fda-0f62-449d-9f02-86ed558d6ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.644938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c816fda-0f62-449d-9f02-86ed558d6ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.645665 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c816fda-0f62-449d-9f02-86ed558d6ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.647317 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c816fda-0f62-449d-9f02-86ed558d6ef0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.657533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1236/2468] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:00.661876 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.672263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd09bc-ab74-411f-b665-a0a7e15f32c7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:00.677828 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:00.678727 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.679008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.679285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] PATH_INFO: `/v3/projects/59b728f47d28481b9a40f276c73a516d/users/07864c81d53e482e9cfc90de4149f8a8/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.696023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b728f47d28481b9a40f276c73a516d, user_id=07864c81d53e482e9cfc90de4149f8a8, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:00.698732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:00.832351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1233/2469] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:00 2022] PUT /identity/v3/projects/59b728f47d28481b9a40f276c73a516d/users/07864c81d53e482e9cfc90de4149f8a8/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:00.850259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:00.850549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:00.850830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:00.877572 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] MFA Rules not processed for user `07864c81d53e482e9cfc90de4149f8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:00.879596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:00.944298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1237/2470] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:00.948884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:00.991608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.010918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dcad5-e1a1-43a5-9862-5d16e87f3cb4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.015733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.016403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.016724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.017003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.017718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.019862 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.115406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1234/2471] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:01.119420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.130878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6dc7f-374f-4b01-b011-186af028f435 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.151896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:01.192972 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.193658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.193995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.194279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.194979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.196935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.289696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1238/2472] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:01 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:01.294072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.304925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6ea0a-5e13-4d2f-a297-0dbf00722840 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.309901 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.310659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.311056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.314055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.314055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.314055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.328868 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1235/2473] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:01.330714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.342072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5e64-ffb0-47b2-b3d2-dafe0e34397e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.350164 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.350901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.351184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.351459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] PATH_INFO: `/v3/projects/f1bbe2a07a044c8392ab36417c17b84f/users/deb4ed1423a349eeac5d9138d505b350/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.370896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbe2a07a044c8392ab36417c17b84f, user_id=deb4ed1423a349eeac5d9138d505b350, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.373553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.460129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1239/2474] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:01 2022] PUT /identity/v3/projects/f1bbe2a07a044c8392ab36417c17b84f/users/deb4ed1423a349eeac5d9138d505b350/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:01.464467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.478419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972342-0404-4f1d-9501-86ed9f7965e6 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.546990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402c86-5cca-411f-aa49-837349987d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.547683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402c86-5cca-411f-aa49-837349987d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.547966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402c86-5cca-411f-aa49-837349987d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.548245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402c86-5cca-411f-aa49-837349987d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.548979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402c86-5cca-411f-aa49-837349987d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.551172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402c86-5cca-411f-aa49-837349987d7f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.567068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1236/2475] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:01.571137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.583061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1545586-dbad-494d-a103-7b062532fa1a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.588163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.591334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.591334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.591334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] PATH_INFO: `/v3/projects/f1bbe2a07a044c8392ab36417c17b84f/users/deb4ed1423a349eeac5d9138d505b350/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.592272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1bbe2a07a044c8392ab36417c17b84f, user_id=deb4ed1423a349eeac5d9138d505b350, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.594693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.606406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1240/2476] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:01 2022] PUT /identity/v3/projects/f1bbe2a07a044c8392ab36417c17b84f/users/deb4ed1423a349eeac5d9138d505b350/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:01.617229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.617520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.617818 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.645104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] MFA Rules not processed for user `deb4ed1423a349eeac5d9138d505b350`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:01.646493 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:01.723559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1237/2477] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:01.735549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:01.740058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:01.804774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087a2ba-ad48-4a24-847a-223b97b76cdd admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:01.809646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a73a6-f8cd-4370-a326-592f6adda974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:01.812476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a73a6-f8cd-4370-a326-592f6adda974 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:01.812476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a73a6-f8cd-4370-a326-592f6adda974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:01.812476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a73a6-f8cd-4370-a326-592f6adda974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:01.830640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a73a6-f8cd-4370-a326-592f6adda974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:01.832226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a73a6-f8cd-4370-a326-592f6adda974 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:01.843699 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1241/2478] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:02.871313 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:02.913847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:02.948173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5267dba8-ee57-42ef-b3ae-37fafed58e33 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:02.952765 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:02.953672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:02.953995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:02.954274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] PATH_INFO: `/v3/users/07864c81d53e482e9cfc90de4149f8a8` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:02.955455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07864c81d53e482e9cfc90de4149f8a8)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:02.960127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:03.207264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07864c81d53e482e9cfc90de4149f8a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:03.219127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07864c81d53e482e9cfc90de4149f8a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:03.299429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07864c81d53e482e9cfc90de4149f8a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:03.300183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07864c81d53e482e9cfc90de4149f8a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:03.307455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07864c81d53e482e9cfc90de4149f8a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:03.313309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1238/2479] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:02 2022] DELETE /identity/v3/users/07864c81d53e482e9cfc90de4149f8a8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:03.318533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:03.318952 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:03.319090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:03.337063 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:03.338277 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:03.397476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1242/2480] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:03.407085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:03.408495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:03.465752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cb8ee-4afd-4751-9be6-cffb16f1981d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:03.469356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:03.470035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:03.470319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:03.470600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:03.480030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:03.481470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:03.492295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1239/2481] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:03.953012 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:03.954839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:03.970896 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a3809-a9b3-4611-a597-a46bd987c5d6 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:03.975822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:03.977831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:03.978144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:03.978458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] PATH_INFO: `/v3/projects/59b728f47d28481b9a40f276c73a516d` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:03.979720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b728f47d28481b9a40f276c73a516d)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:03.981654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:03.998939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:04.118060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b728f47d28481b9a40f276c73a516d', 'request_id': 'req-d739896b-443d-41af-9bed-f126d5931565'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.125968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b728f47d28481b9a40f276c73a516d', 'request_id': 'req-d739896b-443d-41af-9bed-f126d5931565'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.133001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b728f47d28481b9a40f276c73a516d', 'request_id': 'req-d739896b-443d-41af-9bed-f126d5931565'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.204368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] The token cache is being invalidate because project 59b728f47d28481b9a40f276c73a516d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:04.204568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.205247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.211082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1243/2482] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:03 2022] DELETE /identity/v3/projects/59b728f47d28481b9a40f276c73a516d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:04.211931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:04.225005 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c8bc2-0ad4-4d0f-a142-508e128d10b3 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:04.281010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:04.287442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:04.288446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:04.288700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:04.288933 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] PATH_INFO: `/v3/users/deb4ed1423a349eeac5d9138d505b350` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:04.290450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb4ed1423a349eeac5d9138d505b350)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:04.292389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:04.549471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb4ed1423a349eeac5d9138d505b350'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.562560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb4ed1423a349eeac5d9138d505b350'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.637179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb4ed1423a349eeac5d9138d505b350'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.637835 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb4ed1423a349eeac5d9138d505b350'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.646286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ff45de03-6750-4ff6-aa98-59677c1e790d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb4ed1423a349eeac5d9138d505b350'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:04.652548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1240/2483] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:04 2022] DELETE /identity/v3/users/deb4ed1423a349eeac5d9138d505b350 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:05.165123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:05.166907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:05.194283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739896b-443d-41af-9bed-f126d5931565 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:05.262187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:05.263066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:05.263517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:05.263950 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] PATH_INFO: `/v3/projects/f1bbe2a07a044c8392ab36417c17b84f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:05.265579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1bbe2a07a044c8392ab36417c17b84f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:05.267924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:05.450539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1bbe2a07a044c8392ab36417c17b84f', 'request_id': 'req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:05.457573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1bbe2a07a044c8392ab36417c17b84f', 'request_id': 'req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:05.463558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1bbe2a07a044c8392ab36417c17b84f', 'request_id': 'req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:05.609861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] The token cache is being invalidate because project f1bbe2a07a044c8392ab36417c17b84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:05.610108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:05.610835 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-a8fb6ce3-dbcc-4bc0-b4c1-80d5e7ff181e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:05.612742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1244/2484] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:05 2022] DELETE /identity/v3/projects/f1bbe2a07a044c8392ab36417c17b84f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:05.617612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:05.618132 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:05.618592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:05.639701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:05.640936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:05.720983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1241/2485] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:05.730662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:05.730958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:05.731376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:05.752208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:05.754404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:05.764371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1245/2486] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:05.772915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:05.785026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ef21b-9b65-4213-9722-15677fb0ff20 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:05.791526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:05.792522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:05.792880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:05.793314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:05.794175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:05.794556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:05.796286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:05.812130 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1242/2487] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:05.822470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:05.833915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ace7ad-5d8d-4e5d-bca6-846f06d8332a None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:05.839492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:05.840269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:05.840658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:05.841200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:05.842177 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:05.844476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:05.956499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1246/2488] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:05 2022] POST /identity/v3/projects => generated 361 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:05.957750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:05.968217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a420d-5359-4190-b116-462b94a206e0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.031454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.032766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.033059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.033336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.034304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.037189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.046320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:06.135831 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1243/2489] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:05 2022] POST /identity/v3/users => generated 281 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:06.139988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.147215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:06.151126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aff953-77cb-4f04-aa19-4025c27de160 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.156429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.157104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.157390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.159770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.159770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.160549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.174713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1247/2490] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:06.180546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.192657 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441d0f-ed16-4441-8944-c0156ed6de08 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.214813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21b13c-3807-432f-b1c6-47cd34e79339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.215508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b13c-3807-432f-b1c6-47cd34e79339 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.215795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b13c-3807-432f-b1c6-47cd34e79339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.216075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21b13c-3807-432f-b1c6-47cd34e79339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.216816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21b13c-3807-432f-b1c6-47cd34e79339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.219173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21b13c-3807-432f-b1c6-47cd34e79339 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.231785 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1244/2491] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:06.236101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.248574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7d4a-25c6-4114-bfdd-2865547b21a9 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.257569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.258534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.258806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.259518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] PATH_INFO: `/v3/projects/4f65d14f34a24484a37736340029e4ca/users/2e9e783e8aec477c9101ffdf03d4bf92/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.281279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f65d14f34a24484a37736340029e4ca, user_id=2e9e783e8aec477c9101ffdf03d4bf92, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.284691 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.354617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1248/2492] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:06 2022] PUT /identity/v3/projects/4f65d14f34a24484a37736340029e4ca/users/2e9e783e8aec477c9101ffdf03d4bf92/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:06.365852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.366149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.366428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.398070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] MFA Rules not processed for user `2e9e783e8aec477c9101ffdf03d4bf92`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:06.399470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:06.473894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1245/2493] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:06.478318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.545655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c9be3-f327-4cbf-b2d7-07ba71a8b0a7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.551006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.551716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.552001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.552301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.552994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.555009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.629151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1249/2494] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:06 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:06.633584 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.645233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959ce08-c748-42cd-8347-4d1e9c7356d7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.704375 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.705070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.705425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.705711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.706614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.708550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.845190 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1246/2495] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:06 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:06.847683 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.861813 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c9601-c6d1-47d4-986d-aff805443df7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.868594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.869039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.869258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.869542 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.870314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.872069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:06.883907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1250/2496] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:06.888433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:06.898893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c8924-5981-4691-9c60-d64568698801 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:06.903583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:06.904468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:06.904755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:06.905035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] PATH_INFO: `/v3/projects/479f2c880b4542649e6d20d54271044c/users/671b4495b489424eb2ba5d7c305850f3/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:06.921234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=479f2c880b4542649e6d20d54271044c, user_id=671b4495b489424eb2ba5d7c305850f3, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:06.924040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:07.014445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1247/2497] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:06 2022] PUT /identity/v3/projects/479f2c880b4542649e6d20d54271044c/users/671b4495b489424eb2ba5d7c305850f3/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:07.018499 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:07.029073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268222d9-74cc-4c4e-801c-d1621c52d752 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:07.090963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a610cf-9850-40b4-8ba8-30b262e8499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:07.091638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a610cf-9850-40b4-8ba8-30b262e8499d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:07.091926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a610cf-9850-40b4-8ba8-30b262e8499d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:07.092208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a610cf-9850-40b4-8ba8-30b262e8499d admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:07.092938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a610cf-9850-40b4-8ba8-30b262e8499d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:07.094604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a610cf-9850-40b4-8ba8-30b262e8499d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:07.104915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1251/2498] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:07.109135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:07.121018 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0445da-fb21-41b9-961f-5fd75fb3d1de admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:07.126167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:07.127272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:07.127517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:07.127795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] PATH_INFO: `/v3/projects/479f2c880b4542649e6d20d54271044c/users/671b4495b489424eb2ba5d7c305850f3/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:07.130483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479f2c880b4542649e6d20d54271044c, user_id=671b4495b489424eb2ba5d7c305850f3, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:07.133115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:07.143571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1248/2499] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:07 2022] PUT /identity/v3/projects/479f2c880b4542649e6d20d54271044c/users/671b4495b489424eb2ba5d7c305850f3/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:07.155228 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:07.155460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:07.155746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:07.183879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] MFA Rules not processed for user `671b4495b489424eb2ba5d7c305850f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:07.185102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:07.216696 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:07.259422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1252/2500] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:07.271947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:07.273794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:07.303180 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:07.333598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692b00f-e24d-4f5c-a0fc-f815bf4e3382 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:07.337470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15078ee1-8e89-4409-9b48-f894ecf940dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:07.338405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078ee1-8e89-4409-9b48-f894ecf940dc service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:07.338616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078ee1-8e89-4409-9b48-f894ecf940dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:07.338899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15078ee1-8e89-4409-9b48-f894ecf940dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:07.349566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078ee1-8e89-4409-9b48-f894ecf940dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:07.351057 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15078ee1-8e89-4409-9b48-f894ecf940dc service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:07.361500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1249/2501] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:08.339775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:08.403129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb333a10-a804-481c-bf9e-fb1e91507a44 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:08.407926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:08.408801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:08.409645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:08.409980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] PATH_INFO: `/v3/users/2e9e783e8aec477c9101ffdf03d4bf92` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:08.411212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9e783e8aec477c9101ffdf03d4bf92)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:08.413154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:08.611200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9e783e8aec477c9101ffdf03d4bf92'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:08.623608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9e783e8aec477c9101ffdf03d4bf92'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:08.631126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9e783e8aec477c9101ffdf03d4bf92'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:08.631826 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9e783e8aec477c9101ffdf03d4bf92'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:08.632436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9e783e8aec477c9101ffdf03d4bf92'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:08.712537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1253/2502] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:08 2022] DELETE /identity/v3/users/2e9e783e8aec477c9101ffdf03d4bf92 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:08.717149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:08.717660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:08.717770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:08.735812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:08.737010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:08.798209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1250/2503] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:08.808631 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:08.810144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:08.860727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:08.872532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03e352-6ad6-4246-a005-8e4488184b77 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:08.876191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:08.876864 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:08.882084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:08.882084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:08.888406 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:08.889947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:08.901180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1254/2504] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:09.341829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:09.343269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:09.356171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bccbb-782d-45cd-bd84-7fe506703620 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:09.361012 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:09.361916 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:09.362210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:09.363105 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] PATH_INFO: `/v3/projects/4f65d14f34a24484a37736340029e4ca` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:09.364622 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f65d14f34a24484a37736340029e4ca)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:09.366565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:09.480044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f65d14f34a24484a37736340029e4ca', 'request_id': 'req-2cea0f65-8f3d-4ade-b228-6d799aebc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.545998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f65d14f34a24484a37736340029e4ca', 'request_id': 'req-2cea0f65-8f3d-4ade-b228-6d799aebc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.552149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f65d14f34a24484a37736340029e4ca', 'request_id': 'req-2cea0f65-8f3d-4ade-b228-6d799aebc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.563632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] The token cache is being invalidate because project 4f65d14f34a24484a37736340029e4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:09.563941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.564466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.566238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1251/2505] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:09 2022] DELETE /identity/v3/projects/4f65d14f34a24484a37736340029e4ca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:09.570270 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:09.582549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6d8e-8c9b-47e9-81a1-570856f8eca6 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:09.680819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:09.681703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:09.682015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:09.682917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] PATH_INFO: `/v3/users/671b4495b489424eb2ba5d7c305850f3` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:09.684154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671b4495b489424eb2ba5d7c305850f3)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:09.686175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:09.924453 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671b4495b489424eb2ba5d7c305850f3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.960524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671b4495b489424eb2ba5d7c305850f3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.960524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671b4495b489424eb2ba5d7c305850f3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.960524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671b4495b489424eb2ba5d7c305850f3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:09.960524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-78f3e5e2-b747-4a39-a098-f1d0ea7b0a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671b4495b489424eb2ba5d7c305850f3'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.057540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1255/2506] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:09 2022] DELETE /identity/v3/users/671b4495b489424eb2ba5d7c305850f3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:10.462188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:10.463805 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:10.479402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea0f65-8f3d-4ade-b228-6d799aebc486 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:10.538376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:10.548996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:10.550140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.550936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.551227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] PATH_INFO: `/v3/projects/479f2c880b4542649e6d20d54271044c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.552750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=479f2c880b4542649e6d20d54271044c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:10.554741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:10.683186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479f2c880b4542649e6d20d54271044c', 'request_id': 'req-a323f1c8-5510-40ae-8143-25b43f7412cd'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.774693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479f2c880b4542649e6d20d54271044c', 'request_id': 'req-a323f1c8-5510-40ae-8143-25b43f7412cd'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.790207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479f2c880b4542649e6d20d54271044c', 'request_id': 'req-a323f1c8-5510-40ae-8143-25b43f7412cd'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.803271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] The token cache is being invalidate because project 479f2c880b4542649e6d20d54271044c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:10.803572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.804237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a323f1c8-5510-40ae-8143-25b43f7412cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:10.805957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1252/2507] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:10 2022] DELETE /identity/v3/projects/479f2c880b4542649e6d20d54271044c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:10.810791 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.811321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.811424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.830314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:10.831792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:10.904967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1256/2508] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:10.914288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.914288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.914288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.937253 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:10.938644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:10.947694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1253/2509] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:10.951714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:10.962062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd140e-c21a-43b5-9c6e-ad586f85f844 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:10.966854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:10.967670 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:10.967975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:10.968261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:10.968996 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:10.969311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:10.970975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:10.973170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:10.985264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1257/2510] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:10.990688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.000200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b9746-66a2-445c-afe7-cdcf5e39eb02 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.005029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.005676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.006003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.006283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.007176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.013078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.116677 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1254/2511] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:10 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:11.120982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.133370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815744-4f6c-420b-a33b-fed436f563db admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.191747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.192322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.192610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.192891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.193646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.195642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.340744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1258/2512] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:11.344854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.355772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40484f-df30-43fc-bc0b-091099b9fb85 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.360350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.361004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.361287 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.361565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.362338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.364114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.374407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1255/2513] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:11.378892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.388975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910663c-2360-49b4-aa3b-99aac2f33f13 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.395302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5fbfc-b2a9-4507-9ffa-765e8b0d09d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.395959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5fbfc-b2a9-4507-9ffa-765e8b0d09d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.396245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5fbfc-b2a9-4507-9ffa-765e8b0d09d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.396519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5fbfc-b2a9-4507-9ffa-765e8b0d09d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.397243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5fbfc-b2a9-4507-9ffa-765e8b0d09d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.398897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5fbfc-b2a9-4507-9ffa-765e8b0d09d7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.409393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1259/2514] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:11.413939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.423986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75424fe-4c5c-4a12-95a9-ecb3926cb073 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.428946 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.429829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.430117 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.430417 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] PATH_INFO: `/v3/projects/87c2ebbdfda1490f80e2d77eb0b42e90/users/573abcf8d5a949b2bd2aa737faba8e77/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.445704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c2ebbdfda1490f80e2d77eb0b42e90, user_id=573abcf8d5a949b2bd2aa737faba8e77, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.448294 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.559910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1256/2515] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:11 2022] PUT /identity/v3/projects/87c2ebbdfda1490f80e2d77eb0b42e90/users/573abcf8d5a949b2bd2aa737faba8e77/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:11.570977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.571357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.571776 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.599510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] MFA Rules not processed for user `573abcf8d5a949b2bd2aa737faba8e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:11.600736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:11.670219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1260/2516] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:11.675889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.741251 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfab48-7f47-4e2f-aad9-d79fcfe8e5f1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.745817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.746505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.746793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.747071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.747772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.749674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.850850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1257/2517] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:11.858482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:11.870212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45903f-0864-4d4c-96a6-d57672e59e88 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:11.929828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:11.930516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:11.930796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:11.931072 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:11.931781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:11.933742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:11.942833 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:12.039941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1261/2518] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:11 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:12.040152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.047740 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:12.054518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049003-f14d-43d7-ac77-e666e925576c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.059802 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.060598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.061174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.061463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.062358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.079943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.079943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1258/2519] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:12.081038 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.091609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f1e90-b2b2-45ef-9768-31b61436c6fb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.096901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.097873 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.098159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.098603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] PATH_INFO: `/v3/projects/68f552ba7fd34229b266500f0498fd8a/users/ebf1094e37c6440581debc0380d6e26c/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.114525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f552ba7fd34229b266500f0498fd8a, user_id=ebf1094e37c6440581debc0380d6e26c, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.117186 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.206210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1262/2520] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:12 2022] PUT /identity/v3/projects/68f552ba7fd34229b266500f0498fd8a/users/ebf1094e37c6440581debc0380d6e26c/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:12.210310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.243225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d43d2-943e-4569-9022-fef4f0df1834 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.317135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b41065-4558-4552-bcd1-e42e7257bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.324104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41065-4558-4552-bcd1-e42e7257bf18 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.324104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41065-4558-4552-bcd1-e42e7257bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.324104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b41065-4558-4552-bcd1-e42e7257bf18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.324104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b41065-4558-4552-bcd1-e42e7257bf18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.324104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b41065-4558-4552-bcd1-e42e7257bf18 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.330531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1259/2521] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:12.334739 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.344917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e570553-2df6-4291-9d2c-8beeb7a79884 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.350616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.351504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.351793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.352074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] PATH_INFO: `/v3/projects/68f552ba7fd34229b266500f0498fd8a/users/ebf1094e37c6440581debc0380d6e26c/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.354131 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f552ba7fd34229b266500f0498fd8a, user_id=ebf1094e37c6440581debc0380d6e26c, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.356792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.368796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1263/2522] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:12 2022] PUT /identity/v3/projects/68f552ba7fd34229b266500f0498fd8a/users/ebf1094e37c6440581debc0380d6e26c/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:12.382334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.382631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.382914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.409739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] MFA Rules not processed for user `ebf1094e37c6440581debc0380d6e26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:12.410998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:12.480372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1260/2523] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:12.493234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.495023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:12.556314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3277b-98f2-49a3-a861-403627d7565f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.560239 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2f7a-c1b4-4ab0-99b6-2df4d173e4dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.560901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2f7a-c1b4-4ab0-99b6-2df4d173e4dd service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.561189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2f7a-c1b4-4ab0-99b6-2df4d173e4dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.561470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2f7a-c1b4-4ab0-99b6-2df4d173e4dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.571302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2f7a-c1b4-4ab0-99b6-2df4d173e4dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.572703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb2f7a-c1b4-4ab0-99b6-2df4d173e4dd service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.582934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1264/2524] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:12.649537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:12.714932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10958aa-946f-415e-bd56-eda1d318af6c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:12.719637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:12.720578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:12.720863 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:12.721137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] PATH_INFO: `/v3/users/573abcf8d5a949b2bd2aa737faba8e77` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:12.723388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573abcf8d5a949b2bd2aa737faba8e77)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:12.725403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:12.740006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:12.925373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573abcf8d5a949b2bd2aa737faba8e77'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:12.936941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573abcf8d5a949b2bd2aa737faba8e77'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.054713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573abcf8d5a949b2bd2aa737faba8e77'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.055438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573abcf8d5a949b2bd2aa737faba8e77'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.063598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573abcf8d5a949b2bd2aa737faba8e77'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.072247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1261/2525] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:12 2022] DELETE /identity/v3/users/573abcf8d5a949b2bd2aa737faba8e77 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:13.076428 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:13.076898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:13.077087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:13.095587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:13.097326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:13.156965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1265/2526] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:13.167528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:13.168986 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:13.230262 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a80b9-a177-4a1a-9485-a4003508ce09 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:13.233983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:13.234665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:13.234953 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:13.235250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:13.245970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:13.247463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:13.258140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1262/2527] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:13.701514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:13.702975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:13.718067 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ddcf4-2ce1-4c59-9089-635ace2d7665 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:13.720927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:13.722401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:13.722680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:13.722959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] PATH_INFO: `/v3/projects/87c2ebbdfda1490f80e2d77eb0b42e90` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:13.724195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c2ebbdfda1490f80e2d77eb0b42e90)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:13.726478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:13.882219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c2ebbdfda1490f80e2d77eb0b42e90', 'request_id': 'req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.884050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:13.888562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c2ebbdfda1490f80e2d77eb0b42e90', 'request_id': 'req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.894143 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c2ebbdfda1490f80e2d77eb0b42e90', 'request_id': 'req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.984529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] The token cache is being invalidate because project 87c2ebbdfda1490f80e2d77eb0b42e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:13.984748 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.985363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:13.986945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1266/2528] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:13 2022] DELETE /identity/v3/projects/87c2ebbdfda1490f80e2d77eb0b42e90 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:13.991567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:14.001386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661c51-02b8-4087-9d40-7ba05309c1c0 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:14.064870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:14.071302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:14.071302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:14.071302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] PATH_INFO: `/v3/users/ebf1094e37c6440581debc0380d6e26c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:14.072059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf1094e37c6440581debc0380d6e26c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:14.074318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:14.348296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:14.355460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf1094e37c6440581debc0380d6e26c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:14.372100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf1094e37c6440581debc0380d6e26c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:14.448718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf1094e37c6440581debc0380d6e26c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:14.450202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf1094e37c6440581debc0380d6e26c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:14.461790 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1f8d1d8c-616c-41e7-83be-f091a7ddfa2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf1094e37c6440581debc0380d6e26c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:14.469055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1263/2529] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:13 2022] DELETE /identity/v3/users/ebf1094e37c6440581debc0380d6e26c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:15.016646 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.017500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:15.031867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb25eac-986f-4c42-a9d3-45fb9f0a85d1 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.105716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.106689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.107039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.107385 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] PATH_INFO: `/v3/projects/68f552ba7fd34229b266500f0498fd8a` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.108779 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f552ba7fd34229b266500f0498fd8a)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.110854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:15.209480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f552ba7fd34229b266500f0498fd8a', 'request_id': 'req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:15.215790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f552ba7fd34229b266500f0498fd8a', 'request_id': 'req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:15.222047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f552ba7fd34229b266500f0498fd8a', 'request_id': 'req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:15.294384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] The token cache is being invalidate because project 68f552ba7fd34229b266500f0498fd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:15.294676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:15.295306 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-6fb425b4-c9e8-4dee-aa8e-06990ab02e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:15.297083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1267/2530] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:15 2022] DELETE /identity/v3/projects/68f552ba7fd34229b266500f0498fd8a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:15.302890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.303502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.303502 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.321406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:15.322891 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:15.385210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1264/2531] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:15.392638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.392926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.393210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.413059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:15.414286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:15.422815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1268/2532] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:15.427275 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.437596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd0317-66be-4fa7-ba12-0c4affe8428a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.442714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.443373 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.443658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.443934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.444691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:15.445002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.446633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:15.462002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1265/2533] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:15.463563 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.473970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8ee9e-c3e5-44d1-a26b-bcd39984870f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.481636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.482352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.482644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.482925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.483687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.485875 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:15.606868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1269/2534] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:15 2022] POST /identity/v3/projects => generated 391 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:15.611100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.623838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd9982-f43b-4145-8b92-b7bf59a737d7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.697731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.698506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.698820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.699124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.699819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.701743 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:15.793903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1266/2535] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:15 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:15.797585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.814851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4f59c-e69e-49df-9f76-30d9520379f3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.824749 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.825557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.825987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.826367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.827447 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.830733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:15.853904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1270/2536] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:15.859011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.873501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8d218-44e9-4f5b-a798-08f430d21c1c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.889000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8755cf2-fcc8-4d2b-a283-77496d2447e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.890175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8755cf2-fcc8-4d2b-a283-77496d2447e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.890679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8755cf2-fcc8-4d2b-a283-77496d2447e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.896804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8755cf2-fcc8-4d2b-a283-77496d2447e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.896804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8755cf2-fcc8-4d2b-a283-77496d2447e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.896804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8755cf2-fcc8-4d2b-a283-77496d2447e6 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:15.913404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1267/2537] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:15.914740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:15.926444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb82865-cde5-4c7d-962a-eaaaf7e7a1ac admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:15.932151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:15.933128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:15.937519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:15.937519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] PATH_INFO: `/v3/projects/a40edcce79964dd4b3e95c57ff50aa07/users/a90acb00c8fa44daba9adcde1afdc486/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:15.951982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40edcce79964dd4b3e95c57ff50aa07, user_id=a90acb00c8fa44daba9adcde1afdc486, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:15.954736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:16.044587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.045637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.046411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1271/2538] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:15 2022] PUT /identity/v3/projects/a40edcce79964dd4b3e95c57ff50aa07/users/a90acb00c8fa44daba9adcde1afdc486/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:16.046902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:16.083158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] MFA Rules not processed for user `a90acb00c8fa44daba9adcde1afdc486`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:16.085026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:16.094210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:16.162100 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1268/2539] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:16.166982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:16.178216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:16.236216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c01312-a2fe-4f43-9acb-769f09ffbfd7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:16.242445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:16.243108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.243391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.243658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:16.244363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:16.246322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:16.470416 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1272/2540] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:16 2022] POST /identity/v3/projects => generated 391 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:16.472045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:16.483646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ba9a1-9d4e-44d4-ae80-f7f54ca106da None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:16.544234 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:16.545531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.545861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.546145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:16.547906 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:16.548972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:16.671349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1269/2541] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:16 2022] POST /identity/v3/users => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:16.672718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:16.686535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732cd6-7a7b-41da-92da-0f41597878fb admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:16.692756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:16.693536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.694663 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.694945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:16.697223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:16.697905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:16.711089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1273/2542] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:16.715362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:16.732361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc372ec0-0d51-4654-bbf2-3081d5b843f6 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:16.739866 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:16.740486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.740780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.741085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] PATH_INFO: `/v3/projects/cf77015033704b02b555058c4164b564/users/e6ca2e67454147aea598f6c05036397e/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:16.760225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf77015033704b02b555058c4164b564, user_id=e6ca2e67454147aea598f6c05036397e, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:16.763220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:16.860113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1270/2543] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:16 2022] PUT /identity/v3/projects/cf77015033704b02b555058c4164b564/users/e6ca2e67454147aea598f6c05036397e/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:16.865309 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:16.875305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47152f1-93d9-4c18-bf13-cdef35c20462 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:16.953680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:16.953680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.953680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.953680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:16.961539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:16.961539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:16.970312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1274/2544] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:16.975277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:16.989662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17292dfd-77ab-44ec-8327-cdfaa4c1ce15 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:16.998549 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f683e77-c5fc-449a-bd82-ca2fc8d4382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:16.999500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f683e77-c5fc-449a-bd82-ca2fc8d4382c admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:16.999500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f683e77-c5fc-449a-bd82-ca2fc8d4382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:16.999763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f683e77-c5fc-449a-bd82-ca2fc8d4382c admin admin] PATH_INFO: `/v3/projects/cf77015033704b02b555058c4164b564/users/e6ca2e67454147aea598f6c05036397e/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:17.001985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f683e77-c5fc-449a-bd82-ca2fc8d4382c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf77015033704b02b555058c4164b564, user_id=e6ca2e67454147aea598f6c05036397e, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:17.004771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f683e77-c5fc-449a-bd82-ca2fc8d4382c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:17.005617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:17.007534 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:17.019577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1271/2545] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:16 2022] PUT /identity/v3/projects/cf77015033704b02b555058c4164b564/users/e6ca2e67454147aea598f6c05036397e/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:17.028763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:17.030128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:17.030431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:17.059506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] MFA Rules not processed for user `e6ca2e67454147aea598f6c05036397e`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:17.061104 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:17.079840 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645487d3-7b55-4e91-a3be-0f075f522192 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:17.115944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:17.121425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:17.135842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:17.136643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:17.136993 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:17.137342 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:17.139374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:17.152080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1272/2546] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:17.167641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:17.169477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:17.214644 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:17.216138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:17.226741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1275/2547] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:17.243354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7449f7-a682-44d5-962e-2902d3545198 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:17.247503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39470bee-2622-4943-915b-ddeed82ff010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:17.248152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470bee-2622-4943-915b-ddeed82ff010 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:17.248436 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470bee-2622-4943-915b-ddeed82ff010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:17.248716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39470bee-2622-4943-915b-ddeed82ff010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:17.258664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39470bee-2622-4943-915b-ddeed82ff010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:17.260115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39470bee-2622-4943-915b-ddeed82ff010 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:17.270586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1273/2548] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:17.334130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:17.336559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:17.352583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb784f35-066e-478d-942c-875ac97b3116 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:17.356585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:17.357265 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:17.357549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:17.357854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:17.435821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:17.437219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:17.447980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1276/2549] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:17.866203 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:17.866830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:17.866949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:17.887963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] MFA Rules not processed for user `648c1ba14f1842a5b4160a7569e3206e`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:17.889364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:17.968414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1274/2550] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:21.575765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:21.577909 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:21.593784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b847f6e-ab29-4079-b832-5e3690bb8997 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:21.598955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:21.599814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:21.600098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:21.600410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] PATH_INFO: `/v3/users/787efd65008840748e98f9e46e11a1eb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:21.601603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787efd65008840748e98f9e46e11a1eb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:21.603868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:21.892436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787efd65008840748e98f9e46e11a1eb'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.904781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787efd65008840748e98f9e46e11a1eb'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.912767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787efd65008840748e98f9e46e11a1eb'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.913822 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787efd65008840748e98f9e46e11a1eb'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.918348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-3f932360-54b0-4b50-a034-850fd0cb8385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787efd65008840748e98f9e46e11a1eb'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:21.919394 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:21.992869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1277/2551] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:21 2022] DELETE /identity/v3/users/787efd65008840748e98f9e46e11a1eb => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:22.280060 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.299501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6a9c0-7744-48ca-b68d-ca296206ee34 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.371768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.372744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.373103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.373455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] PATH_INFO: `/v3/projects/2f5df9a6a9764dde96014824c7456331` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.374821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5df9a6a9764dde96014824c7456331)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.377161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:22.551405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:22.564011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5df9a6a9764dde96014824c7456331', 'request_id': 'req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.671520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5df9a6a9764dde96014824c7456331', 'request_id': 'req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.678887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5df9a6a9764dde96014824c7456331', 'request_id': 'req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.696349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] The token cache is being invalidate because project 2f5df9a6a9764dde96014824c7456331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:22.696935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.697652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-3690e943-a5d8-4f9c-9586-f891bf6ae7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:22.699686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1275/2552] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:22 2022] DELETE /identity/v3/projects/2f5df9a6a9764dde96014824c7456331 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:22.704515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.704994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.705092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.732877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:22.734147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:22.811152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1278/2553] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:22.814666 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.814976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.815905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.841936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:22.843306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:22.857013 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1276/2554] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:22.857390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.868636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bbfb6-c193-4609-bd94-c29eaec9c4a3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.878409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.878409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.878409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.878409 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.878975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:22.878975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.878975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:22.894217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1279/2555] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:30:22.897252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:22.906715 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1a58c-3985-445d-b6cc-a86c7bf33b94 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:22.911803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:22.912491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:22.913087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:22.913087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:22.913704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:22.915738 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.037172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1277/2556] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:22 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:23.040052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.053217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95ff16-f96f-42e2-8efd-24ef59d1b65c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.126731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.127435 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.127719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.128086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.128968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.131033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.216858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.218892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:23.239610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1280/2557] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:23.244491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.245452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05863f18-5a92-4c7f-a3a3-df4b2cfff89c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.257427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.259812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.269414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6a453-de0f-4fa6-b0f4-0e8c2eaba13e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.282795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.283581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] PATH_INFO: `/v3/users/a90acb00c8fa44daba9adcde1afdc486` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.287069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90acb00c8fa44daba9adcde1afdc486)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.291367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.294690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.295442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.295832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.296494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.297467 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.299241 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.322538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1281/2558] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:23.323595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.339729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048562d-f2b7-4299-8d3b-d1370f007399 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.344668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.345446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.345867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.346251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.347284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.349047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.361720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1282/2559] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:23.366774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.384668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0c983-16cb-44f4-ac97-22b23c8dede5 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.390116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30afecb-30f8-4052-a0ab-c0d7bd402f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.391092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afecb-30f8-4052-a0ab-c0d7bd402f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.391575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afecb-30f8-4052-a0ab-c0d7bd402f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.391949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30afecb-30f8-4052-a0ab-c0d7bd402f68 admin admin] PATH_INFO: `/v3/projects/5f46f33512314f65a371a09733d13136/users/6a1c427885bf4658baa78fa487ab91fa/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.412480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afecb-30f8-4052-a0ab-c0d7bd402f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f46f33512314f65a371a09733d13136, user_id=6a1c427885bf4658baa78fa487ab91fa, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.416636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30afecb-30f8-4052-a0ab-c0d7bd402f68 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.544960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1283/2560] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:23 2022] PUT /identity/v3/projects/5f46f33512314f65a371a09733d13136/users/6a1c427885bf4658baa78fa487ab91fa/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:23.560977 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90acb00c8fa44daba9adcde1afdc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:23.569778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.570789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.571378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.601845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90acb00c8fa44daba9adcde1afdc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:23.637371 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] MFA Rules not processed for user `6a1c427885bf4658baa78fa487ab91fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:23.640403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:23.655015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:23.728368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1284/2561] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:23.733303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.740619 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90acb00c8fa44daba9adcde1afdc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:23.741890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90acb00c8fa44daba9adcde1afdc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:23.750597 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-0f052dfd-801b-443f-b487-e70f4d667a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90acb00c8fa44daba9adcde1afdc486'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:23.761881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1278/2562] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:23 2022] DELETE /identity/v3/users/a90acb00c8fa44daba9adcde1afdc486 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:23.768957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.769591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.771363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.802207 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:23.803750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:23.825135 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b593834-a286-46e5-9758-6552cab9d688 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:23.924398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1279/2563] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:23.935319 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:23.937472 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:23.937727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:23.938688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:23.939008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:23.939292 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:23.940015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:23.942061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:23.950589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:24.009678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eff0b4-b87a-495a-938c-9972a566d83f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.019737 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.020480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.020830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.021210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.031408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.032894 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.043913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1280/2564] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:24.121054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1285/2565] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:23 2022] POST /identity/v3/projects => generated 381 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:30:24.130513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.133568 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:24.174334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147f74a-845e-4d2e-a8cd-9200e339fff3 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.325596 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.328789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.330086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.330537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.331515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.333928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.530822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1281/2566] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:24 2022] POST /identity/v3/users => generated 297 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:24.535219 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.551785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603637f-1026-43a3-9434-939eded8e313 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.556921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.557573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.557897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.565212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.565212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.565212 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.572387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1286/2567] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:24.576670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.589108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40f8ee-8c6c-4661-a3ee-f4a7d7994f4d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.594793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.595314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.595731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.595918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] PATH_INFO: `/v3/projects/0c8811d610214150b8ad7370b2714fb1/users/b8de962c287f4befb45978e77fc85adb/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.614589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8811d610214150b8ad7370b2714fb1, user_id=b8de962c287f4befb45978e77fc85adb, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.617268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.658667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.665248 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:24.703240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1282/2568] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:24 2022] PUT /identity/v3/projects/0c8811d610214150b8ad7370b2714fb1/users/b8de962c287f4befb45978e77fc85adb/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:24.709053 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.717503 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bbcd4-a4c9-4d13-814d-4f093d3dec1d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.772571 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:24.815173 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.817082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.817582 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.818106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] PATH_INFO: `/v3/projects/a40edcce79964dd4b3e95c57ff50aa07` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.819606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40edcce79964dd4b3e95c57ff50aa07)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.821781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.836709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c0222-4ac6-4a9d-a635-d9f9e09881bd admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.844017 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.844533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.844895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.845241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.846415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.850073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.872669 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1283/2569] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:24.876955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:24.891572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdae5a-a1fb-498e-abd1-4f73a0af829d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:24.896937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2a9ca-7448-4f74-8c93-eb94b1c76f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:24.898085 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a9ca-7448-4f74-8c93-eb94b1c76f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.898487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a9ca-7448-4f74-8c93-eb94b1c76f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.898832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2a9ca-7448-4f74-8c93-eb94b1c76f60 admin admin] PATH_INFO: `/v3/projects/0c8811d610214150b8ad7370b2714fb1/users/b8de962c287f4befb45978e77fc85adb/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.900921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2a9ca-7448-4f74-8c93-eb94b1c76f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8811d610214150b8ad7370b2714fb1, user_id=b8de962c287f4befb45978e77fc85adb, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:24.903830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2a9ca-7448-4f74-8c93-eb94b1c76f60 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:24.913908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:24.920044 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1284/2570] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:24 2022] PUT /identity/v3/projects/0c8811d610214150b8ad7370b2714fb1/users/b8de962c287f4befb45978e77fc85adb/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:24.932571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e620e-7408-4729-a22d-0608965c52cd None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:24.932957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e620e-7408-4729-a22d-0608965c52cd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:24.933271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e620e-7408-4729-a22d-0608965c52cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:24.990671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-370e620e-7408-4729-a22d-0608965c52cd None None] MFA Rules not processed for user `b8de962c287f4befb45978e77fc85adb`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:24.991235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-370e620e-7408-4729-a22d-0608965c52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:24.992213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40edcce79964dd4b3e95c57ff50aa07', 'request_id': 'req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.004141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40edcce79964dd4b3e95c57ff50aa07', 'request_id': 'req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.011978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40edcce79964dd4b3e95c57ff50aa07', 'request_id': 'req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.074757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1285/2571] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:25.086462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e620e-7408-4729-a22d-0608965c52cd None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:25.087902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-370e620e-7408-4729-a22d-0608965c52cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:25.123707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] The token cache is being invalidate because project a40edcce79964dd4b3e95c57ff50aa07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:25.130425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.130425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.130425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1287/2572] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:24 2022] DELETE /identity/v3/projects/a40edcce79964dd4b3e95c57ff50aa07 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:25.131761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:25.133336 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:25.151411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e620e-7408-4729-a22d-0608965c52cd None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:25.155537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:25.156295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:25.157400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:25.158059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:25.162684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:25.175515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:25.177016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:25.187601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1286/2573] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:25.208971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c43c86-6df7-4ac8-bb8c-dea06a736f4f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:25.214281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:25.215162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:25.215446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:25.215742 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] PATH_INFO: `/v3/users/e6ca2e67454147aea598f6c05036397e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:25.216936 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ca2e67454147aea598f6c05036397e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:25.219074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:25.538535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:25.539936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:25.551333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d6c2e-aaff-487d-b8d4-5179b120ceae service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:25.554970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:25.555630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:25.555936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:25.556215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:25.558021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:25.587042 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ca2e67454147aea598f6c05036397e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.602134 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ca2e67454147aea598f6c05036397e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.605226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:25.613607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ca2e67454147aea598f6c05036397e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.614544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ca2e67454147aea598f6c05036397e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.615483 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-083a3ff1-8860-40c1-8821-a0b77fee65d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ca2e67454147aea598f6c05036397e'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:25.627405 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:25.632826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:25.641250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1287/2574] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:30:25.695763 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1288/2575] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:25 2022] DELETE /identity/v3/users/e6ca2e67454147aea598f6c05036397e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:26.148402 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:26.160525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ac9c7-c1f8-4a9b-8823-30be5d478cfd service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:26.188965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:26.224448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:26.225310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.225587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.225888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] PATH_INFO: `/v3/projects/cf77015033704b02b555058c4164b564` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.227094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf77015033704b02b555058c4164b564)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:26.228998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:26.392768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf77015033704b02b555058c4164b564', 'request_id': 'req-16899e85-b59f-4623-97b9-a8b5e6c29e34'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.494525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf77015033704b02b555058c4164b564', 'request_id': 'req-16899e85-b59f-4623-97b9-a8b5e6c29e34'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.500744 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf77015033704b02b555058c4164b564', 'request_id': 'req-16899e85-b59f-4623-97b9-a8b5e6c29e34'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.512664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] The token cache is being invalidate because project cf77015033704b02b555058c4164b564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:26.512963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.513624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-16899e85-b59f-4623-97b9-a8b5e6c29e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:26.515227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1288/2576] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:26 2022] DELETE /identity/v3/projects/cf77015033704b02b555058c4164b564 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:26.520397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.520900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.521141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.541595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:26.542892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:26.605235 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1289/2577] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:26.614212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.614687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.616186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.634229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:26.635497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:26.656123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1289/2578] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:26.656307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:26.658769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c404ab8-e82d-4ead-9a08-296cefb6e1af None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:26.663920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:26.664575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.664870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.665171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.665918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:26.666490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:26.668170 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:26.680443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1290/2579] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:26.684796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:26.694893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fc905-f1b4-48b3-b5e8-a52da695441a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:26.699769 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:26.700413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.700701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.700985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.701680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:26.703633 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:26.776627 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1290/2580] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:26 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:26.780792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:26.791977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad991ecc-ce28-4ed0-9560-38a64a0ed436 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:26.848718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:26.849389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:26.849678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:26.850002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:26.850703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:26.852657 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:26.980138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1291/2581] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:26 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:26.984450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:26.995820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ce5e5-88a3-4806-b9eb-5dca5962a38a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:27.000346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:27.001000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.001279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.001656 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.002432 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:27.005166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:27.015410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1291/2582] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:27.019652 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:27.029786 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96491f5c-9339-4d49-8d1a-a255a089211f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:27.034821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15d6ef-2d0f-42ca-a9f5-c6b46444e7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:27.035517 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d6ef-2d0f-42ca-a9f5-c6b46444e7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.035799 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d6ef-2d0f-42ca-a9f5-c6b46444e7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.036073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15d6ef-2d0f-42ca-a9f5-c6b46444e7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.036795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d6ef-2d0f-42ca-a9f5-c6b46444e7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:27.038425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15d6ef-2d0f-42ca-a9f5-c6b46444e7d7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:27.048714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1292/2583] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:27.053410 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:27.063176 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fef1f9-8202-48d6-80c9-0e96a4c9fb71 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:27.068770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:27.069725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.070059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.070348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] PATH_INFO: `/v3/projects/3de2f4a6d04b47eeabc252a4802957d2/users/b4fc33384e304e78b36cd36dce23f265/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.086016 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de2f4a6d04b47eeabc252a4802957d2, user_id=b4fc33384e304e78b36cd36dce23f265, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:27.088678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:27.152011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1292/2584] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:27 2022] PUT /identity/v3/projects/3de2f4a6d04b47eeabc252a4802957d2/users/b4fc33384e304e78b36cd36dce23f265/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:27.166642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780464-4129-416b-afdd-d3d1d6b83071 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.166935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780464-4129-416b-afdd-d3d1d6b83071 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.167236 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9780464-4129-416b-afdd-d3d1d6b83071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.196551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a9780464-4129-416b-afdd-d3d1d6b83071 None None] MFA Rules not processed for user `b4fc33384e304e78b36cd36dce23f265`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:27.197775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a9780464-4129-416b-afdd-d3d1d6b83071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:27.240163 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:27.266814 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1293/2585] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:27.277577 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:27.279624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:27.338592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732680d-241e-4d7e-b568-f7aba0c661bf admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:27.342311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:27.343037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:27.343276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:27.343555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:27.350899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:27.352913 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:27.354491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:27.364024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1293/2586] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:29.110087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3760af-3bf0-4dc5-8d6b-a8bf1d6422ce None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:29.110612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3760af-3bf0-4dc5-8d6b-a8bf1d6422ce None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:29.110710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3760af-3bf0-4dc5-8d6b-a8bf1d6422ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:29.127994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-2e3760af-3bf0-4dc5-8d6b-a8bf1d6422ce None None] MFA Rules not processed for user `b4fc33384e304e78b36cd36dce23f265`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:29.129352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2e3760af-3bf0-4dc5-8d6b-a8bf1d6422ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:29.136275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1294/2587] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:36.263962 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:36.265538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:36.335152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125330-4655-4d5c-a82f-06e5a34735a6 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:36.339895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:36.340782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:36.341059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:36.341339 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] PATH_INFO: `/v3/users/6a1c427885bf4658baa78fa487ab91fa` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:36.342574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1c427885bf4658baa78fa487ab91fa)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:36.344514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:36.578404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1c427885bf4658baa78fa487ab91fa'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:36.591254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1c427885bf4658baa78fa487ab91fa'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:36.683194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1c427885bf4658baa78fa487ab91fa'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:36.683852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1c427885bf4658baa78fa487ab91fa'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:36.691859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1c427885bf4658baa78fa487ab91fa'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:36.699050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1294/2588] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:36 2022] DELETE /identity/v3/users/6a1c427885bf4658baa78fa487ab91fa => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:36.703471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796517c2-becc-464d-9945-2652b773c336 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:36.704006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796517c2-becc-464d-9945-2652b773c336 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:36.704109 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796517c2-becc-464d-9945-2652b773c336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:36.723332 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-796517c2-becc-464d-9945-2652b773c336 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:36.724546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-796517c2-becc-464d-9945-2652b773c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:36.782496 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1295/2589] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:36.793066 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:36.794515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:36.851602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8390c5-121f-4b37-b46d-95886359d1f4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:36.855174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:36.855823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:36.856113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:36.856393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:36.865609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:36.867101 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:36.877049 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1295/2590] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:37.421679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796517c2-becc-464d-9945-2652b773c336 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:37.423283 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-796517c2-becc-464d-9945-2652b773c336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:37.436246 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796517c2-becc-464d-9945-2652b773c336 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:37.441706 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:37.442638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:37.442951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:37.443240 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] PATH_INFO: `/v3/projects/5f46f33512314f65a371a09733d13136` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:37.444461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f46f33512314f65a371a09733d13136)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:37.446579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:37.564245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f46f33512314f65a371a09733d13136', 'request_id': 'req-2e546c53-b249-4fc5-83fa-470c6146ff78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:37.571512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f46f33512314f65a371a09733d13136', 'request_id': 'req-2e546c53-b249-4fc5-83fa-470c6146ff78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:37.577587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f46f33512314f65a371a09733d13136', 'request_id': 'req-2e546c53-b249-4fc5-83fa-470c6146ff78'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:37.671637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] The token cache is being invalidate because project 5f46f33512314f65a371a09733d13136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:37.672000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:37.672684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:37.674327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1296/2591] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:37 2022] DELETE /identity/v3/projects/5f46f33512314f65a371a09733d13136 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:37.678454 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:37.688659 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69a71e-910b-4310-aff3-56ef968c7cb7 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:37.703813 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:37.758204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:37.759089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:37.759427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:37.763538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] PATH_INFO: `/v3/users/b8de962c287f4befb45978e77fc85adb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:37.763538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8de962c287f4befb45978e77fc85adb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:37.763538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:37.973647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8de962c287f4befb45978e77fc85adb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:37.985678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8de962c287f4befb45978e77fc85adb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.054164 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8de962c287f4befb45978e77fc85adb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.054775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8de962c287f4befb45978e77fc85adb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.062082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a8a71f8a-3618-4500-bebe-31298c000549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8de962c287f4befb45978e77fc85adb'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.069238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1296/2592] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:37 2022] DELETE /identity/v3/users/b8de962c287f4befb45978e77fc85adb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:38.554053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:38.555803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:38.573093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e546c53-b249-4fc5-83fa-470c6146ff78 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:38.646528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:38.652705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:38.653609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:38.653932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:38.654218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] PATH_INFO: `/v3/projects/0c8811d610214150b8ad7370b2714fb1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:38.655569 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8811d610214150b8ad7370b2714fb1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:38.657510 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:38.760462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8811d610214150b8ad7370b2714fb1', 'request_id': 'req-93e29123-7205-484e-a312-fe41afe577da'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.767516 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8811d610214150b8ad7370b2714fb1', 'request_id': 'req-93e29123-7205-484e-a312-fe41afe577da'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.779490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8811d610214150b8ad7370b2714fb1', 'request_id': 'req-93e29123-7205-484e-a312-fe41afe577da'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.884187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] The token cache is being invalidate because project 0c8811d610214150b8ad7370b2714fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:38.884533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.885192 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-93e29123-7205-484e-a312-fe41afe577da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:38.888391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1297/2593] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:38 2022] DELETE /identity/v3/projects/0c8811d610214150b8ad7370b2714fb1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:38.898047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:38.898047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:38.898047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:38.919500 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:38.921041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:39.012668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1297/2594] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:39.020654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.021054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.021361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.044874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:39.046477 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:39.061628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1298/2595] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:39.062592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.074061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4418-406d-41ab-8424-0f5d11e2f6d2 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.081450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.081450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.082529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.082819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.084156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:39.084156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.087131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.105039 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1298/2596] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:30:39.106537 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.117728 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435208c-c217-42ce-af2a-df8c78d9301b None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.123650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.124404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.124761 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.125115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.125961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.130485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.260838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1299/2597] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:39 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:39.265302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.278970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804611d4-5fe6-49a9-a6ec-83f9ad3a4537 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.307220 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:39.346209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.346887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.347177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.347508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.348316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.350394 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.469524 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1299/2598] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:39 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:39.471986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.493290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b175d5-9ee7-49bb-ab22-07c9f37cebf2 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.502026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.502789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.504595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.504595 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.507487 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.509158 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.532885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1300/2599] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:39.533792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.548372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557553c5-4e9f-4580-96ad-dd01671896e6 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.555915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f42e80-b7d5-4c4b-90c1-a77d71fc2206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.557191 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42e80-b7d5-4c4b-90c1-a77d71fc2206 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.557501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42e80-b7d5-4c4b-90c1-a77d71fc2206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.557923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f42e80-b7d5-4c4b-90c1-a77d71fc2206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.558680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42e80-b7d5-4c4b-90c1-a77d71fc2206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.561471 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f42e80-b7d5-4c4b-90c1-a77d71fc2206 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.574525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1300/2600] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:39.582051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:39.596599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb158-6799-48f4-b58e-63dc6ef50f3a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:39.601912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:39.603045 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.603244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.604105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] PATH_INFO: `/v3/projects/d395443091fd4a55b718496ff1e8124e/users/9576d86f59b74e009a93d7cc2d1e7fc7/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.629643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d395443091fd4a55b718496ff1e8124e, user_id=9576d86f59b74e009a93d7cc2d1e7fc7, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:39.632659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:39.862142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1301/2601] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:39 2022] PUT /identity/v3/projects/d395443091fd4a55b718496ff1e8124e/users/9576d86f59b74e009a93d7cc2d1e7fc7/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:39.874551 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:39.874846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:39.875115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:39.911219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] MFA Rules not processed for user `9576d86f59b74e009a93d7cc2d1e7fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:39.912662 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:39.996535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1301/2602] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:40.001205 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.122445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788f6b-b246-474b-850c-df64caf00af2 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.129839 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.130628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.130991 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.131897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.133299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.136828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.393387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1302/2603] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/projects => generated 383 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:40.397984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.409245 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801a5bb-e1c4-46d4-a7e5-4a5f3c4cef84 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.480318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.481035 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.481351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.481630 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.482418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.484508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.588074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1302/2604] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:40.592080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.604189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4363cf-5491-42c2-a881-fbf2c3971ee3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.610054 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.610736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.611044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.611318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.612068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.614148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.617606 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:40.631971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1303/2605] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:30:40.636422 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.649963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0edcd-4032-4882-b45c-4dc4ccc4b0a5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.654949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.655840 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.656171 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.656552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] PATH_INFO: `/v3/projects/9f3fc787b6f4480baf7061ca9c7319c6/users/e283d72fa5ba43989ee87a7a2b777572/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.676606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3fc787b6f4480baf7061ca9c7319c6, user_id=e283d72fa5ba43989ee87a7a2b777572, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.681487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.821390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:40.827309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1303/2606] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:40 2022] PUT /identity/v3/projects/9f3fc787b6f4480baf7061ca9c7319c6/users/e283d72fa5ba43989ee87a7a2b777572/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:40.831196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.843632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08770d-aa7e-4317-8e95-d9253498c6a5 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.916029 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb991f-6a25-478e-90f7-d5039cf0c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.916931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb991f-6a25-478e-90f7-d5039cf0c737 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.917245 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb991f-6a25-478e-90f7-d5039cf0c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.917528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb991f-6a25-478e-90f7-d5039cf0c737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.918318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb991f-6a25-478e-90f7-d5039cf0c737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.920061 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb991f-6a25-478e-90f7-d5039cf0c737 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.931178 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1304/2607] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:40.935823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:40.948716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53f1f3-c909-481d-bb0d-1168391c3fcb admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:40.954686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:40.955670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.955959 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.956239 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] PATH_INFO: `/v3/projects/9f3fc787b6f4480baf7061ca9c7319c6/users/e283d72fa5ba43989ee87a7a2b777572/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:40.959442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3fc787b6f4480baf7061ca9c7319c6, user_id=e283d72fa5ba43989ee87a7a2b777572, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:40.962532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:40.979355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1304/2608] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:40 2022] PUT /identity/v3/projects/9f3fc787b6f4480baf7061ca9c7319c6/users/e283d72fa5ba43989ee87a7a2b777572/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:40.991422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326587-b98c-4a20-834c-6bd2841403af None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:40.991717 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326587-b98c-4a20-834c-6bd2841403af None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:40.991998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326587-b98c-4a20-834c-6bd2841403af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:41.026635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-86326587-b98c-4a20-834c-6bd2841403af None None] MFA Rules not processed for user `e283d72fa5ba43989ee87a7a2b777572`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:41.028124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-86326587-b98c-4a20-834c-6bd2841403af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:41.131842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1305/2609] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:41.144791 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:41.146787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:41.249614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46470ee9-188c-4d2f-83e7-79dfff9358ce admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:41.258679 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:41.259439 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:41.259730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:41.259996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:41.272236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:41.273650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:41.294389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1305/2610] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:41.478386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86326587-b98c-4a20-834c-6bd2841403af None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:41.496018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86326587-b98c-4a20-834c-6bd2841403af None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:41.501144 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55846d5a-23ac-4e03-b83e-55d7f263e185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:41.502094 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846d5a-23ac-4e03-b83e-55d7f263e185 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:41.503466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846d5a-23ac-4e03-b83e-55d7f263e185 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:41.504954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55846d5a-23ac-4e03-b83e-55d7f263e185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:41.598688 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55846d5a-23ac-4e03-b83e-55d7f263e185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:41.600207 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55846d5a-23ac-4e03-b83e-55d7f263e185 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:41.613388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1306/2611] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:42.363721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:42.496592 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720429-07d7-42b4-8343-129727ce6098 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:42.506387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:42.507648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:42.508227 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:42.508535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] PATH_INFO: `/v3/users/9576d86f59b74e009a93d7cc2d1e7fc7` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:42.510508 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9576d86f59b74e009a93d7cc2d1e7fc7)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:42.514232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:42.827261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9576d86f59b74e009a93d7cc2d1e7fc7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:42.843721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9576d86f59b74e009a93d7cc2d1e7fc7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:42.934192 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9576d86f59b74e009a93d7cc2d1e7fc7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:42.934879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9576d86f59b74e009a93d7cc2d1e7fc7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:42.943631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9576d86f59b74e009a93d7cc2d1e7fc7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:42.950390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1306/2612] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:42 2022] DELETE /identity/v3/users/9576d86f59b74e009a93d7cc2d1e7fc7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:42.954731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:42.955227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:42.955352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:42.974459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:42.975671 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:42.990417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:43.039298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1307/2613] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:43.049299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:43.051724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:43.062685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:43.116156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc3aee-5ffd-4ed0-9a1c-b3cf3e0ea28b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:43.120175 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:43.120847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:43.121236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:43.121588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:43.131842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:43.133363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:43.143362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1307/2614] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:43.674953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:43.676195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:43.709237 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482cb86-ff80-48d0-a4fa-960d3b24b5ba None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:43.722274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:43.726318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:43.726759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:43.727249 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] PATH_INFO: `/v3/projects/d395443091fd4a55b718496ff1e8124e` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:43.728676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d395443091fd4a55b718496ff1e8124e)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:43.730849 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:43.869349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd395443091fd4a55b718496ff1e8124e', 'request_id': 'req-87852ea5-8c3c-4c8a-8cb2-b278f865618c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:43.876667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd395443091fd4a55b718496ff1e8124e', 'request_id': 'req-87852ea5-8c3c-4c8a-8cb2-b278f865618c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:43.883623 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd395443091fd4a55b718496ff1e8124e', 'request_id': 'req-87852ea5-8c3c-4c8a-8cb2-b278f865618c'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:43.981460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] The token cache is being invalidate because project d395443091fd4a55b718496ff1e8124e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:43.982130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:43.989612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:43.989612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1308/2615] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:43 2022] DELETE /identity/v3/projects/d395443091fd4a55b718496ff1e8124e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:43.989884 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:43.999949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c9d66-346c-4c64-b932-33c769a6dd8f service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:44.064554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:44.065428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:44.070138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:44.070499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] PATH_INFO: `/v3/users/e283d72fa5ba43989ee87a7a2b777572` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:44.071900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e283d72fa5ba43989ee87a7a2b777572)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:44.073902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:44.315097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e283d72fa5ba43989ee87a7a2b777572'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:44.327397 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e283d72fa5ba43989ee87a7a2b777572'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:44.443398 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e283d72fa5ba43989ee87a7a2b777572'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:44.444056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e283d72fa5ba43989ee87a7a2b777572'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:44.451795 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-9925a1e8-3e7b-4e70-8995-03a5e29d51fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e283d72fa5ba43989ee87a7a2b777572'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:44.458775 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1308/2616] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:43 2022] DELETE /identity/v3/users/e283d72fa5ba43989ee87a7a2b777572 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:30:44.966484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:44.968261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:44.993206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87852ea5-8c3c-4c8a-8cb2-b278f865618c admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:45.075398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:45.077044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.077345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.077628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] PATH_INFO: `/v3/projects/9f3fc787b6f4480baf7061ca9c7319c6` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.079059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3fc787b6f4480baf7061ca9c7319c6)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:45.081329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:45.207460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:45.211567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3fc787b6f4480baf7061ca9c7319c6', 'request_id': 'req-194d9ed3-4005-4b3e-b24e-6279f39d90a6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:45.218546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3fc787b6f4480baf7061ca9c7319c6', 'request_id': 'req-194d9ed3-4005-4b3e-b24e-6279f39d90a6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:45.225089 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3fc787b6f4480baf7061ca9c7319c6', 'request_id': 'req-194d9ed3-4005-4b3e-b24e-6279f39d90a6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:45.374552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] The token cache is being invalidate because project 9f3fc787b6f4480baf7061ca9c7319c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:45.374892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:45.375474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-194d9ed3-4005-4b3e-b24e-6279f39d90a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:45.377411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1309/2617] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:44 2022] DELETE /identity/v3/projects/9f3fc787b6f4480baf7061ca9c7319c6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:45.382297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.382830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.382932 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.401140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:45.402419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:45.432264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:45.471363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1309/2618] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:45.479736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.480121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.480522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.502462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:45.504366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:45.514193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1310/2619] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:45.518671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:45.532423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3307-1bb6-45a9-a676-0aab54c4583f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:45.542448 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:45.543138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.543424 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.543702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.545246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:30:45.545560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:45.547304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:45.560711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1310/2620] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:30:45.565666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:45.577774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a503a-9fe9-42d2-bd3a-27c3c3655596 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:45.586129 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:45.586869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.587183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.588617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.589352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:45.591730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:45.712490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1311/2621] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:30:45 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:45.715588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:45.734266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3d262-63fd-407c-b307-6b8a51fa136b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:45.812461 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:45.813147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.813433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.813712 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.814608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:45.817183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:45.930794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1311/2622] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:30:45 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:30:45.934944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:45.947379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2cf0b-f077-42bc-9bdc-54c404f006d3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:45.952330 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:45.953080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.953372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.953653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.954459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:45.956068 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:45.969861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1312/2623] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:45.971265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:45.983187 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efe4dd-8675-476e-b1be-e711a1901645 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:45.988700 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b144-a0c3-49b9-832a-22742fcf8db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:45.989464 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b144-a0c3-49b9-832a-22742fcf8db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:45.989756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b144-a0c3-49b9-832a-22742fcf8db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:45.990078 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b144-a0c3-49b9-832a-22742fcf8db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:45.990816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b144-a0c3-49b9-832a-22742fcf8db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:45.992455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b144-a0c3-49b9-832a-22742fcf8db3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:46.003326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1312/2624] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:30:46.007834 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:46.018313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac0cf5-37d6-4df8-9b20-50d7e16c7703 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:46.023675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:46.024681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:46.024974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:46.025252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] PATH_INFO: `/v3/projects/4e4347ff601d44919c07241d2c6ed7b7/users/5176ce39f7454001801102da4242d064/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:46.041403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4347ff601d44919c07241d2c6ed7b7, user_id=5176ce39f7454001801102da4242d064, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:46.044372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:46.135174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1313/2625] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:30:46 2022] PUT /identity/v3/projects/4e4347ff601d44919c07241d2c6ed7b7/users/5176ce39f7454001801102da4242d064/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:46.146896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:46.147182 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:46.147465 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:46.177015 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] MFA Rules not processed for user `5176ce39f7454001801102da4242d064`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:46.178336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:46.245446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1313/2626] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:46.259049 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:46.260836 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:46.321695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12bed7-0daf-436f-97e4-9180c04e2fd3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:46.325480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e7545-1433-4a45-a002-873125d98636 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:46.326217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7545-1433-4a45-a002-873125d98636 service glance] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:46.326507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7545-1433-4a45-a002-873125d98636 service glance] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:46.326792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e7545-1433-4a45-a002-873125d98636 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:46.336374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e7545-1433-4a45-a002-873125d98636 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:46.337877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e7545-1433-4a45-a002-873125d98636 service glance] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:46.347879 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1314/2627] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:49.404386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.405934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:49.434680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:49.465409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89fb12-7543-403f-abb0-3d3dc0f3acd3 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.469137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.469779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.470089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.470367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.472295 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:49.490851 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.491697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.491980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.510377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:49.511599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:49.537587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.539077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.552573 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1314/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:49.577001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1315/2629] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:30:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:30:49.849750 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:49.851366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:49.938541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c76ff-9d9f-442c-a432-35903345eba8 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:49.944522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b72ecf-0d6d-4bc7-85b6-1f56b2802cd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:49.945325 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b72ecf-0d6d-4bc7-85b6-1f56b2802cd6 service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:49.945642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b72ecf-0d6d-4bc7-85b6-1f56b2802cd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:49.946157 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b72ecf-0d6d-4bc7-85b6-1f56b2802cd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:49.958452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b72ecf-0d6d-4bc7-85b6-1f56b2802cd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:49.960468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b72ecf-0d6d-4bc7-85b6-1f56b2802cd6 service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:49.974208 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1315/2630] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:30:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:50.966008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:50.968497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:50.990167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:51.056863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6eba7-7ace-48a4-a3e6-434cad7acc47 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.063152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.063999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.070961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.070961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.070961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.087553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.090189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.105519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1316/2631] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:51.116735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cbddf-f118-40e3-a83f-d0744049e0ed None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.117301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cbddf-f118-40e3-a83f-d0744049e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.117301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cbddf-f118-40e3-a83f-d0744049e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.136587 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2e3cbddf-f118-40e3-a83f-d0744049e0ed None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:51.138141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2e3cbddf-f118-40e3-a83f-d0744049e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:51.147761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1316/2632] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jun 20 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:51.164729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:51.176281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbfc4e-ae18-4fb7-a1ff-b09629741e08 service nova] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:51.182710 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:51.183522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:51.183930 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:51.184326 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:51.200051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:51.202255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:51.221945 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1317/2633] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:30:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:52.016939 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cf4e-c897-460b-8151-0aebaad9728d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:52.017235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cf4e-c897-460b-8151-0aebaad9728d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:52.017518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17cf4e-c897-460b-8151-0aebaad9728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:52.038647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-cb17cf4e-c897-460b-8151-0aebaad9728d None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:52.039889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cb17cf4e-c897-460b-8151-0aebaad9728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:52.048051 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1317/2634] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:52.061585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:52.080941 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7872-77b1-46d7-8793-f612b3b6f8b7 service swift] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:52.086946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:52.088078 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:52.088365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:52.088648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:52.098278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:52.100024 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:52.109243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1318/2635] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:30:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:52.764346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:52.764870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:52.765236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:52.789523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:52.790966 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:52.801371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1318/2636] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jun 20 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:52.817112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:52.833480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560e98-b774-4c71-8fc9-02fc75630208 service swift] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:52.853195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376304c-742c-4f23-87c3-4eb16b2a3f24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:52.854293 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376304c-742c-4f23-87c3-4eb16b2a3f24 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:52.855048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376304c-742c-4f23-87c3-4eb16b2a3f24 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:52.855806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376304c-742c-4f23-87c3-4eb16b2a3f24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:52.870115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376304c-742c-4f23-87c3-4eb16b2a3f24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:52.872529 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376304c-742c-4f23-87c3-4eb16b2a3f24 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:52.888832 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1319/2637] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:30:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:30:55.681026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:55.682590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:55.733071 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:55.753135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d251927-ca90-450a-be24-1048f09f7c68 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:55.758541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:55.759429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:55.759714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:55.759993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] PATH_INFO: `/v3/users/b4fc33384e304e78b36cd36dce23f265` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:55.761225 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fc33384e304e78b36cd36dce23f265)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:55.763233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:55.984515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fc33384e304e78b36cd36dce23f265'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:55.997620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fc33384e304e78b36cd36dce23f265'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.094442 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fc33384e304e78b36cd36dce23f265'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.095056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fc33384e304e78b36cd36dce23f265'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.108821 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fc33384e304e78b36cd36dce23f265'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.117526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1319/2638] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:30:55 2022] DELETE /identity/v3/users/b4fc33384e304e78b36cd36dce23f265 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:56.122272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:56.122745 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:56.122880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:56.140935 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:30:56.142151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:56.203700 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1320/2639] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:30:56.214166 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:56.221091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:56.275825 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d38ed-5ae7-46b7-9292-10fbf227299a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:56.279337 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:56.279980 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:56.280259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:56.280533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:56.290814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:56.292640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:56.303701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1320/2640] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:30:56.566753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:56.568415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:56.581540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0b1c7-1171-4405-9ae8-8033943db7d5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:56.587401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:56.588304 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:56.588594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:56.588878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] PATH_INFO: `/v3/projects/3de2f4a6d04b47eeabc252a4802957d2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:56.590122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de2f4a6d04b47eeabc252a4802957d2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:56.592058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:56.724989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de2f4a6d04b47eeabc252a4802957d2', 'request_id': 'req-c76fcda7-88e3-4768-9e49-b0c96493f7b8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.731920 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de2f4a6d04b47eeabc252a4802957d2', 'request_id': 'req-c76fcda7-88e3-4768-9e49-b0c96493f7b8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.733876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:56.737735 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de2f4a6d04b47eeabc252a4802957d2', 'request_id': 'req-c76fcda7-88e3-4768-9e49-b0c96493f7b8'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.842982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] The token cache is being invalidate because project 3de2f4a6d04b47eeabc252a4802957d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:30:56.843274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:30:56.847196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.847329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:56.847452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:30:56.849124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1321/2641] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:30:56 2022] DELETE /identity/v3/projects/3de2f4a6d04b47eeabc252a4802957d2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:30:56.858161 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee960ef1-f216-4bd0-9ea3-28c58ade67dc service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:30:56.916293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:30:56.916975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:30:56.917509 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:30:56.917783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:30:56.920115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:30:56.950435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:30:56.995599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:30:56.997365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:30:57.010356 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1321/2642] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:31:03.780180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:03.781693 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:03.869344 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fcda7-88e3-4768-9e49-b0c96493f7b8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:03.875181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:03.875600 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:03.876680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:03.876680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:03.878050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:03.902806 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:03.904468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:03.916065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1322/2643] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:04.806462 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:04.807988 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:04.820320 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f1fcf-7a3c-4b57-a4c4-fe2858706883 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:04.825147 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:04.826056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:04.826350 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:04.826632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] PATH_INFO: `/v3/users/85d4be423d794100ac5b00d32fb5620c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:04.827829 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d4be423d794100ac5b00d32fb5620c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:04.829827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:04.912960 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:04.914387 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:04.928561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a09b31-2210-4752-9bc5-b1342ecb9947 service placement] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:04.933244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:04.934159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:04.934446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:04.934753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] PATH_INFO: `/v3/users/5176ce39f7454001801102da4242d064` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:04.935975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5176ce39f7454001801102da4242d064)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:04.937917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:05.075948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d4be423d794100ac5b00d32fb5620c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.094301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d4be423d794100ac5b00d32fb5620c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.174562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d4be423d794100ac5b00d32fb5620c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.175434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d4be423d794100ac5b00d32fb5620c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.184545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-62e0af22-d1bb-4f94-aae1-d1f2fa712d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d4be423d794100ac5b00d32fb5620c'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.190429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5176ce39f7454001801102da4242d064'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.192082 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1322/2644] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:04 2022] DELETE /identity/v3/users/85d4be423d794100ac5b00d32fb5620c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:05.205108 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5176ce39f7454001801102da4242d064'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.213322 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5176ce39f7454001801102da4242d064'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.214518 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5176ce39f7454001801102da4242d064'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.215128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5176ce39f7454001801102da4242d064'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.334977 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1323/2645] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:04 2022] DELETE /identity/v3/users/5176ce39f7454001801102da4242d064 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:05.339730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.340056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.340341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.357544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:05.358803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:05.423240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1323/2646] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:05.433494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:05.434933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:05.462054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:05.463647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:05.477675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff5fa1-9ced-4df6-b9cf-953bd9eb7664 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:05.482642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:05.484095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.484095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.484318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] PATH_INFO: `/v3/projects/ae372a6537684625acb82b36862bde25` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.485545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae372a6537684625acb82b36862bde25)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:05.487875 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:05.510675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:05.516632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72880a18-bf21-4474-9f22-be62f67826c1 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:05.521162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:05.521845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.522137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.522417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.531964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:05.533465 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:05.544096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1324/2647] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:05.611338 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:05.629167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae372a6537684625acb82b36862bde25', 'request_id': 'req-06836f26-6eff-4b13-a941-ae828698c092'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.728794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae372a6537684625acb82b36862bde25', 'request_id': 'req-06836f26-6eff-4b13-a941-ae828698c092'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.734776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae372a6537684625acb82b36862bde25', 'request_id': 'req-06836f26-6eff-4b13-a941-ae828698c092'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.746684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] The token cache is being invalidate because project ae372a6537684625acb82b36862bde25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:05.746978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.747639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:05.749211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1324/2648] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:05 2022] DELETE /identity/v3/projects/ae372a6537684625acb82b36862bde25 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:05.753191 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:05.763222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f888bf9-b9d1-4267-8511-c7b6669518bb service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:05.828900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:05.830269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:05.830611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:05.830947 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] PATH_INFO: `/v3/users/bc51d114c672470291af52ff627887f4` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:05.833417 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc51d114c672470291af52ff627887f4)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:05.836082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.069907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.069907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.092046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc51d114c672470291af52ff627887f4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.092771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06836f26-6eff-4b13-a941-ae828698c092 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.097760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.104280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.104280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.104280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] PATH_INFO: `/v3/projects/4e4347ff601d44919c07241d2c6ed7b7` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.104280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4347ff601d44919c07241d2c6ed7b7)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.104280 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.107997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc51d114c672470291af52ff627887f4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.118331 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc51d114c672470291af52ff627887f4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.119070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc51d114c672470291af52ff627887f4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.119679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-af702095-88d9-405d-8c0d-b24fdd242b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc51d114c672470291af52ff627887f4'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.228101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1325/2649] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:05 2022] DELETE /identity/v3/users/bc51d114c672470291af52ff627887f4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:06.284886 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4347ff601d44919c07241d2c6ed7b7', 'request_id': 'req-20f89280-0089-41a3-9250-e087a14e74dd'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.385687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4347ff601d44919c07241d2c6ed7b7', 'request_id': 'req-20f89280-0089-41a3-9250-e087a14e74dd'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.391899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4347ff601d44919c07241d2c6ed7b7', 'request_id': 'req-20f89280-0089-41a3-9250-e087a14e74dd'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.404163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] The token cache is being invalidate because project 4e4347ff601d44919c07241d2c6ed7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:06.404458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.405483 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-20f89280-0089-41a3-9250-e087a14e74dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.407248 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1325/2650] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:06 2022] DELETE /identity/v3/projects/4e4347ff601d44919c07241d2c6ed7b7 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:06.412127 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.412424 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.412738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.430884 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:06.432255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.496337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1326/2651] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:06.505372 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.505663 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.505978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.524948 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:06.526172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.534293 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1326/2652] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:06.538774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.549452 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.549614 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5194b-da65-40b4-b449-ca7a3c0ae1c5 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.552533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.555498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.556223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.556493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.556774 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.557513 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:31:06.557877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.559555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.562625 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:06.570576 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c0979-48e1-48db-b658-1ac69f85e364 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.575031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1327/2653] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:31:06.577692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.578546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.579128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.579528 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.579938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] PATH_INFO: `/v3/projects/07483bf3b747478d8310ea34de228630` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.581341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07483bf3b747478d8310ea34de228630)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.584503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.588759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb226c-32fa-49ee-8e82-614ceccabc4d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.593540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.594218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.594504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.594784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.595504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.597380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.725529 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07483bf3b747478d8310ea34de228630', 'request_id': 'req-78f9b7ce-c160-496b-ad4f-624e6b716474'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.732830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1328/2654] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:06 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:06.737185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.798762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112dc21-5407-4cde-b139-ffefef26a7ee admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:06.804128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:06.804820 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:06.805113 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:06.805393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:06.806123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:06.808148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:06.814235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07483bf3b747478d8310ea34de228630', 'request_id': 'req-78f9b7ce-c160-496b-ad4f-624e6b716474'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.821571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07483bf3b747478d8310ea34de228630', 'request_id': 'req-78f9b7ce-c160-496b-ad4f-624e6b716474'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.833776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] The token cache is being invalidate because project 07483bf3b747478d8310ea34de228630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:06.834096 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.834759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:06.836344 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1327/2655] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:06 2022] DELETE /identity/v3/projects/07483bf3b747478d8310ea34de228630 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:06.913300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1329/2656] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:06 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:06.922366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:06.923812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:06.946731 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:06.996975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b7ce-c160-496b-ad4f-624e6b716474 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.001897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.002609 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.003304 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.004697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.006122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.007848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.018754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1328/2657] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:07.024117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.034852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f62cc4-cdf5-4112-93a2-16b6c97de27a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.040701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeff81a-f6b4-4c84-a045-3b5b0c47dd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.041398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeff81a-f6b4-4c84-a045-3b5b0c47dd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.041684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeff81a-f6b4-4c84-a045-3b5b0c47dd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.042006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeff81a-f6b4-4c84-a045-3b5b0c47dd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.043006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeff81a-f6b4-4c84-a045-3b5b0c47dd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.044687 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeff81a-f6b4-4c84-a045-3b5b0c47dd34 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.056576 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1330/2658] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:07.060992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.073726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7cee-05f8-46c8-9103-c50c7a334bcf admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.080547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.081773 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.083181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.083648 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] PATH_INFO: `/v3/projects/ecd4388a530b4091953e2be198a78d84/users/4becea83473f4717bf75c627bfcb358f/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.101664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd4388a530b4091953e2be198a78d84, user_id=4becea83473f4717bf75c627bfcb358f, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.104447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.203445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1329/2659] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:07 2022] PUT /identity/v3/projects/ecd4388a530b4091953e2be198a78d84/users/4becea83473f4717bf75c627bfcb358f/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:07.214755 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.215272 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.215359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.242583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] MFA Rules not processed for user `4becea83473f4717bf75c627bfcb358f`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:07.243801 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:07.310926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1331/2660] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:07.315506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.379602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c963349-13b2-4792-b4e2-0eb82563cc43 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.384352 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.385002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.385283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.385558 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.386278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.388167 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.478885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1330/2661] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:07 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:07.482842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.494375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a9cc-f694-4873-9691-25d4e4da53af None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.536507 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:07.554162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.554871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.555160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.555441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.556251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.558251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.679111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1332/2662] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:07 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:07.687852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.698265 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4dd376-5f98-4ac4-92d9-4b2a7e0f4e3c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.702823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.703485 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.703770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.704050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.704869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.706521 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.717437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1331/2663] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:07.725390 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.735589 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb81f6-a59e-42c6-ad3b-0da16f425fb7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:07.741215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:07.742124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:07.742405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:07.742682 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] PATH_INFO: `/v3/projects/dc2029458a634dfca90742cbcf1de22d/users/e1ac7be0f161447380a52f81147ef818/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:07.760159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2029458a634dfca90742cbcf1de22d, user_id=e1ac7be0f161447380a52f81147ef818, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:07.762984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:07.929519 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1333/2664] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:07 2022] PUT /identity/v3/projects/dc2029458a634dfca90742cbcf1de22d/users/e1ac7be0f161447380a52f81147ef818/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:07.933445 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:07.944431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac7feb-9542-40e5-aa85-5c85ada6eaa6 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:08.000998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fb18b-0e72-483a-93fc-d08f170448b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:08.001672 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb18b-0e72-483a-93fc-d08f170448b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:08.001987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb18b-0e72-483a-93fc-d08f170448b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:08.002269 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fb18b-0e72-483a-93fc-d08f170448b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:08.003047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb18b-0e72-483a-93fc-d08f170448b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:08.005399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fb18b-0e72-483a-93fc-d08f170448b3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:08.007632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:08.016089 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1332/2665] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:08.020393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:08.030898 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536aaafb-c326-4946-9ff3-bead333ef07a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:08.036168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:08.037081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:08.037370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:08.037667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] PATH_INFO: `/v3/projects/dc2029458a634dfca90742cbcf1de22d/users/e1ac7be0f161447380a52f81147ef818/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:08.039709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2029458a634dfca90742cbcf1de22d, user_id=e1ac7be0f161447380a52f81147ef818, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:08.042775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:08.054222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1334/2666] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:08 2022] PUT /identity/v3/projects/dc2029458a634dfca90742cbcf1de22d/users/e1ac7be0f161447380a52f81147ef818/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:08.065379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346ca6-5ccf-437f-9935-6e154ec29a81 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:08.071149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346ca6-5ccf-437f-9935-6e154ec29a81 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:08.071149 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346ca6-5ccf-437f-9935-6e154ec29a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:08.092900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-6c346ca6-5ccf-437f-9935-6e154ec29a81 None None] MFA Rules not processed for user `e1ac7be0f161447380a52f81147ef818`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:08.094142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-6c346ca6-5ccf-437f-9935-6e154ec29a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:08.162099 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1333/2667] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:08.173557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:08.175274 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:08.235847 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e89309-0ee9-458a-979b-36ce6cdc8c87 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:08.240066 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:08.240709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:08.240999 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:08.241278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:08.297607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:08.299102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:08.308575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1335/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:09.983151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:09.983696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:09.983696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:10.003238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:10.005009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:10.062762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1334/2669] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:31:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:10.076658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:10.078105 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:10.133227 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:10.154725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4a9c9-7c97-429b-a45d-bd8b909df9b9 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:10.160276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934b029-40b5-4450-b177-b7cded8cf0e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:10.161051 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934b029-40b5-4450-b177-b7cded8cf0e2 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:10.161338 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934b029-40b5-4450-b177-b7cded8cf0e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:10.161616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934b029-40b5-4450-b177-b7cded8cf0e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:10.170149 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934b029-40b5-4450-b177-b7cded8cf0e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:10.171756 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934b029-40b5-4450-b177-b7cded8cf0e2 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:10.180461 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1336/2670] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:31:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:11.464557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:11.564156 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe656f-567e-4021-a660-863d7d446622 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:11.570126 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:11.571023 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:11.571307 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:11.571588 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] PATH_INFO: `/v3/users/4becea83473f4717bf75c627bfcb358f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:11.572801 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4becea83473f4717bf75c627bfcb358f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:11.574779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:11.809653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:11.826593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4becea83473f4717bf75c627bfcb358f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:11.843693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4becea83473f4717bf75c627bfcb358f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:11.911989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4becea83473f4717bf75c627bfcb358f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:11.913444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4becea83473f4717bf75c627bfcb358f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:11.923579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4becea83473f4717bf75c627bfcb358f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:11.934488 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1335/2671] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:11 2022] DELETE /identity/v3/users/4becea83473f4717bf75c627bfcb358f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:11.936187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:11.936685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:11.936787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:11.956260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:11.957415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:12.027260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1337/2672] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:31:12.036554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:12.038004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:12.111392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e9251-f628-49d7-b5e4-ac97d57c8af0 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:12.116389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:12.117041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:12.117341 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:12.117697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:12.131578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:12.133067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:12.146846 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1336/2673] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:12.673922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:12.675613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:12.689740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdf658-bbfc-4c5f-b141-89cda3055357 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:12.697561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:12.698598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:12.698809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:12.699138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] PATH_INFO: `/v3/projects/ecd4388a530b4091953e2be198a78d84` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:12.700349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd4388a530b4091953e2be198a78d84)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:12.705431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:12.808479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd4388a530b4091953e2be198a78d84', 'request_id': 'req-828bec10-62c9-4b86-acb0-2be090038ef0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:12.815525 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd4388a530b4091953e2be198a78d84', 'request_id': 'req-828bec10-62c9-4b86-acb0-2be090038ef0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:12.823980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd4388a530b4091953e2be198a78d84', 'request_id': 'req-828bec10-62c9-4b86-acb0-2be090038ef0'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:12.918231 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] The token cache is being invalidate because project ecd4388a530b4091953e2be198a78d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:12.918641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:12.919474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:12.921093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1338/2674] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:12 2022] DELETE /identity/v3/projects/ecd4388a530b4091953e2be198a78d84 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:12.927276 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:12.937527 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73a18-1f78-4467-b7e4-ae38288735ce service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:13.010083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:13.010987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:13.011301 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:13.011585 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] PATH_INFO: `/v3/users/e1ac7be0f161447380a52f81147ef818` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:13.012905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ac7be0f161447380a52f81147ef818)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:13.015002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:13.618763 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ac7be0f161447380a52f81147ef818'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:13.623371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:13.632574 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ac7be0f161447380a52f81147ef818'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:13.723212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ac7be0f161447380a52f81147ef818'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:13.723859 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ac7be0f161447380a52f81147ef818'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:13.731416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-1942d20e-7b92-4052-b2f6-60658012c484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ac7be0f161447380a52f81147ef818'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:13.738346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1337/2675] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:12 2022] DELETE /identity/v3/users/e1ac7be0f161447380a52f81147ef818 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:14.280018 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:14.282769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:14.301184 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bec10-62c9-4b86-acb0-2be090038ef0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:14.370151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:14.371043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:14.371323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:14.371596 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] PATH_INFO: `/v3/projects/dc2029458a634dfca90742cbcf1de22d` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:14.372819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2029458a634dfca90742cbcf1de22d)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:14.374778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:14.382906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:14.479869 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2029458a634dfca90742cbcf1de22d', 'request_id': 'req-383074e4-b465-40cb-bb37-c2d9cfd166fd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:14.493086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2029458a634dfca90742cbcf1de22d', 'request_id': 'req-383074e4-b465-40cb-bb37-c2d9cfd166fd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:14.498969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2029458a634dfca90742cbcf1de22d', 'request_id': 'req-383074e4-b465-40cb-bb37-c2d9cfd166fd'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:14.564277 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] The token cache is being invalidate because project dc2029458a634dfca90742cbcf1de22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:14.564662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:14.565303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-383074e4-b465-40cb-bb37-c2d9cfd166fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:14.567854 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1339/2676] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:14 2022] DELETE /identity/v3/projects/dc2029458a634dfca90742cbcf1de22d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:14.572747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:14.573604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:14.574088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:14.594760 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:14.595994 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:14.674460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1338/2677] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:14.676689 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:14.677151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:14.677444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:14.712680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:14.714104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:14.728844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1340/2678] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:14.733296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:14.744455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a440193-d1b4-4d0f-a094-6e2bd55e08b6 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:14.751274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:14.755355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:14.755699 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:14.755989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:14.756759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:31:14.757074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:14.759087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:14.772591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1339/2679] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:31:14.777392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:14.790612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051220f-527d-47b1-b09a-b4ec92bd34e9 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:14.795772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:14.796438 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:14.796722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:14.796997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:14.797703 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:14.799655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:14.925868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1341/2680] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:14 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:14.928140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:14.939091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261746-c9ac-4255-b919-ef4a21a281f8 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.004475 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.005425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.005714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.006173 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.007091 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.010593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.130667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1340/2681] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:14 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:15.132168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.143378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea080e-ab25-49b1-986f-bba9e9d97747 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.150166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.150166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.150166 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.150753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.151429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.152912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.164901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1342/2682] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:15.169069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.181032 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139982c5-d446-4098-8009-ca1f61a32600 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.186037 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3291270-9451-4295-8d28-14fab28eecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.186972 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291270-9451-4295-8d28-14fab28eecab admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.187264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291270-9451-4295-8d28-14fab28eecab admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.187547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3291270-9451-4295-8d28-14fab28eecab admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.188281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291270-9451-4295-8d28-14fab28eecab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.190006 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3291270-9451-4295-8d28-14fab28eecab admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.202613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1341/2683] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:15.206744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.220796 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d00c0-1032-4eab-81e0-e431cd3fc119 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.226122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.227147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.227446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.227775 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] PATH_INFO: `/v3/projects/9e7caec5d7c048d8af44dad7faea2c66/users/d42c1ce421634960b44534ce1a344b7a/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.247648 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7caec5d7c048d8af44dad7faea2c66, user_id=d42c1ce421634960b44534ce1a344b7a, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.250723 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.329633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1343/2684] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:15 2022] PUT /identity/v3/projects/9e7caec5d7c048d8af44dad7faea2c66/users/d42c1ce421634960b44534ce1a344b7a/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:15.340107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.340426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.340692 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.373362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] MFA Rules not processed for user `d42c1ce421634960b44534ce1a344b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:15.375008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:15.403652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:15.463608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1342/2685] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:15.464946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.549214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1ba8-a312-44e5-a8e0-537ffcc0ddef admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.554716 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.555450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.555803 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.556103 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.556925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.559087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.643841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1344/2686] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:15 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:15.648538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.665407 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fb2c2-9fa5-492a-a69d-e96a8419fc52 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.737348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.738520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.739093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.739537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.740393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.742546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.839310 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1343/2687] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:15 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:31:15.843978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.856782 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0123823-f641-4a26-8700-b7cdaad75b78 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.861971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.862655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.862926 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.863264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.864886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.866647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.882927 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1345/2688] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:15.884059 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.899855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6b4e5-f5ba-42e1-8267-fa33c52d7771 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.909984 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1c002-5c83-4ac9-b1a7-211c67c2021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.910917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1c002-5c83-4ac9-b1a7-211c67c2021f admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.911315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1c002-5c83-4ac9-b1a7-211c67c2021f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.911867 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1c002-5c83-4ac9-b1a7-211c67c2021f admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.912678 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1c002-5c83-4ac9-b1a7-211c67c2021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.914620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1c002-5c83-4ac9-b1a7-211c67c2021f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:15.935029 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1344/2689] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:15.938096 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:15.944441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:15.950903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e3e12-74af-48aa-91b4-003360795079 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:15.956201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:15.957709 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:15.958088 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:15.958398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] PATH_INFO: `/v3/projects/a546a1bfc2a74f519f9c5fa8f660898c/users/8a466e6459b7422bb64fd4a0087c008d/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:15.976247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a546a1bfc2a74f519f9c5fa8f660898c, user_id=8a466e6459b7422bb64fd4a0087c008d, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:15.979372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:16.100887 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1346/2690] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:15 2022] PUT /identity/v3/projects/a546a1bfc2a74f519f9c5fa8f660898c/users/8a466e6459b7422bb64fd4a0087c008d/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:16.117562 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:16.117975 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:16.118335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:16.148002 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] MFA Rules not processed for user `8a466e6459b7422bb64fd4a0087c008d`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:16.149340 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:16.227486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1345/2691] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:16.228917 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:16.307970 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d81266-1e74-4bc6-9895-52ef0e8bcdd8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:16.313680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:16.314391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:16.314679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:16.314961 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:16.315666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:16.318289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:16.437420 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1347/2692] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:16 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:16.438706 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:16.450820 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec8811-244c-4ea7-9841-cb31695cd399 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:16.487571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:16.518021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:16.518714 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:16.518990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:16.519272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:16.519974 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:16.522119 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:17.148718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1346/2693] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:16 2022] POST /identity/v3/users => generated 297 bytes in 709 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:17.151122 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:17.165016 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce72150-51c2-44eb-8ac9-a94703e71d10 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:17.170082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:17.171008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:17.171360 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:17.171729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:17.172676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:17.174413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:17.187594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1348/2694] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:17.192196 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:17.203174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56805-e941-4d38-833d-9bb186ad824f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:17.208430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:17.209316 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:17.209598 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:17.209908 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] PATH_INFO: `/v3/projects/f61b0d76563c4c5d8f3734e887e520c8/users/99bb5e0cc0d64aa39076997d9fbc3dd1/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:17.237184 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61b0d76563c4c5d8f3734e887e520c8, user_id=99bb5e0cc0d64aa39076997d9fbc3dd1, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:17.240138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:17.303281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1347/2695] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:17 2022] PUT /identity/v3/projects/f61b0d76563c4c5d8f3734e887e520c8/users/99bb5e0cc0d64aa39076997d9fbc3dd1/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:17.307396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:17.321532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39086c-2477-42a6-8fb9-5336fb28eb21 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:17.390645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0de98-a648-43ec-8125-5635b783694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:17.391372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0de98-a648-43ec-8125-5635b783694e admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:17.391752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0de98-a648-43ec-8125-5635b783694e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:17.392142 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0de98-a648-43ec-8125-5635b783694e admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:17.392980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0de98-a648-43ec-8125-5635b783694e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:17.396532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0de98-a648-43ec-8125-5635b783694e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:17.408698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1349/2696] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:17.413640 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:17.428357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de605f9-fe82-4007-938f-424ceea71a42 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:17.433506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:17.434440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:17.434721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:17.434997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] PATH_INFO: `/v3/projects/f61b0d76563c4c5d8f3734e887e520c8/users/99bb5e0cc0d64aa39076997d9fbc3dd1/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:17.438351 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61b0d76563c4c5d8f3734e887e520c8, user_id=99bb5e0cc0d64aa39076997d9fbc3dd1, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:17.440902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:17.453484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1348/2697] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:17 2022] PUT /identity/v3/projects/f61b0d76563c4c5d8f3734e887e520c8/users/99bb5e0cc0d64aa39076997d9fbc3dd1/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:17.464361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:17.464877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:17.464978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:17.494718 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] MFA Rules not processed for user `99bb5e0cc0d64aa39076997d9fbc3dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:17.495931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:17.544497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:17.578821 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1350/2698] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:17.591151 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:17.592995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:17.677565 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2acbd-1411-44c1-993f-64f175fd1d5b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:17.681431 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:17.682123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:17.682406 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:17.682680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:17.757232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:17.758888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:17.773047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1349/2699] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:19.898206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:19.899677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:19.912111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffe787-c602-4776-b873-076a0c90ebf3 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:19.918071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:19.918071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:19.918071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:19.918071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:19.979640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:19.981097 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:19.993153 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1351/2700] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:22.002983 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:22.012695 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceddc5-f180-45fa-bf23-e614aa4bd6b0 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:22.016707 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968219d-7d58-431c-95ef-3ad734e23752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:22.017430 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968219d-7d58-431c-95ef-3ad734e23752 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:22.017826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968219d-7d58-431c-95ef-3ad734e23752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:22.019090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968219d-7d58-431c-95ef-3ad734e23752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:22.029481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968219d-7d58-431c-95ef-3ad734e23752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:22.030996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968219d-7d58-431c-95ef-3ad734e23752 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:22.042326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1350/2701] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 12:31:26.667279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:26.730635 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df3c74-3fdb-4620-bc2d-261d143cfa5e service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:26.735059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:26.735918 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:26.736200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:26.736476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] PATH_INFO: `/v3/users/d42c1ce421634960b44534ce1a344b7a` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:26.737645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42c1ce421634960b44534ce1a344b7a)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:26.740494 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:26.950940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42c1ce421634960b44534ce1a344b7a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:26.964746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42c1ce421634960b44534ce1a344b7a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:26.971747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42c1ce421634960b44534ce1a344b7a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:26.972458 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42c1ce421634960b44534ce1a344b7a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:26.973871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42c1ce421634960b44534ce1a344b7a'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:26.975545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:27.055017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1352/2702] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:26 2022] DELETE /identity/v3/users/d42c1ce421634960b44534ce1a344b7a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:27.059612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440150-f891-43cc-8b0a-9072fc5496fc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:27.060131 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440150-f891-43cc-8b0a-9072fc5496fc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:27.060241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440150-f891-43cc-8b0a-9072fc5496fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:27.077484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-da440150-f891-43cc-8b0a-9072fc5496fc None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:27.079457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-da440150-f891-43cc-8b0a-9072fc5496fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:27.102535 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:27.142123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1351/2703] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:27.155102 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:27.156878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:27.218389 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a3934-86d8-4ea0-8662-5a298d2ec8b0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:27.222451 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:27.223405 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:27.223694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:27.224009 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:27.228286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a975-427e-4703-b841-de9c101fff1a None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:27.228601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a975-427e-4703-b841-de9c101fff1a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:27.228845 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004a975-427e-4703-b841-de9c101fff1a None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:27.230396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1352/2704] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 12:31:27.235008 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:27.235299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:27.235581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:27.244962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:27.246498 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:27.259459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:27.259459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:27.260128 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1353/2705] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:27.330121 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1353/2706] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:31:27.341828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:27.343557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:27.413233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d0e68-f254-4d85-a20d-17044d72db1b service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:27.416982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:27.417628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:27.417953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:27.418501 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:27.429321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:27.430923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:27.441981 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1354/2707] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:27.780704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:27.782198 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:27.796923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba402ed-db09-497c-9d40-dfbfe95e5bfc None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:27.802229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:27.803092 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:27.803370 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:27.803642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] PATH_INFO: `/v3/projects/9e7caec5d7c048d8af44dad7faea2c66` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:27.804934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7caec5d7c048d8af44dad7faea2c66)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:27.806879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:27.943450 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7caec5d7c048d8af44dad7faea2c66', 'request_id': 'req-261ffd26-5fee-4476-8d4f-7698697f330e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.048552 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7caec5d7c048d8af44dad7faea2c66', 'request_id': 'req-261ffd26-5fee-4476-8d4f-7698697f330e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.054923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7caec5d7c048d8af44dad7faea2c66', 'request_id': 'req-261ffd26-5fee-4476-8d4f-7698697f330e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.066834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] The token cache is being invalidate because project 9e7caec5d7c048d8af44dad7faea2c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:28.067457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.067970 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.069575 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1354/2708] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:27 2022] DELETE /identity/v3/projects/9e7caec5d7c048d8af44dad7faea2c66 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:28.073946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:28.085781 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766f89f-683c-4b50-8a1e-d76b0656bcb9 service glance] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:28.147206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:28.148085 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:28.148372 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:28.148653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] PATH_INFO: `/v3/users/8a466e6459b7422bb64fd4a0087c008d` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:28.149865 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a466e6459b7422bb64fd4a0087c008d)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:28.151788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:28.368183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:INSERT=1,keystone:DELETE=6,keystone:SELECT=93 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:28.374171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a466e6459b7422bb64fd4a0087c008d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.395777 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a466e6459b7422bb64fd4a0087c008d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.395899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a466e6459b7422bb64fd4a0087c008d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.396545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a466e6459b7422bb64fd4a0087c008d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.397215 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a466e6459b7422bb64fd4a0087c008d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:28.454784 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1355/2709] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:28 2022] DELETE /identity/v3/users/8a466e6459b7422bb64fd4a0087c008d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:28.879065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:28.882217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:28.894660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ffd26-5fee-4476-8d4f-7698697f330e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:28.944162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:28.954540 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:28.955440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:28.955852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:28.956144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] PATH_INFO: `/v3/projects/a546a1bfc2a74f519f9c5fa8f660898c` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:28.957360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a546a1bfc2a74f519f9c5fa8f660898c)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:28.959311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:29.090515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a546a1bfc2a74f519f9c5fa8f660898c', 'request_id': 'req-77d00f96-c08f-4065-af8f-4ee2de00c9e7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.185969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a546a1bfc2a74f519f9c5fa8f660898c', 'request_id': 'req-77d00f96-c08f-4065-af8f-4ee2de00c9e7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.192591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a546a1bfc2a74f519f9c5fa8f660898c', 'request_id': 'req-77d00f96-c08f-4065-af8f-4ee2de00c9e7'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.203842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] The token cache is being invalidate because project a546a1bfc2a74f519f9c5fa8f660898c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:29.204097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.204736 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.206314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1355/2710] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:28 2022] DELETE /identity/v3/projects/a546a1bfc2a74f519f9c5fa8f660898c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:29.210911 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:29.212302 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:29.226301 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de70398-d280-416c-8e7d-c33517fffbdc admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:29.283152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:29.284023 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:29.284386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:29.284668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] PATH_INFO: `/v3/users/99bb5e0cc0d64aa39076997d9fbc3dd1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:29.286588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bb5e0cc0d64aa39076997d9fbc3dd1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:29.288538 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:29.491958 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bb5e0cc0d64aa39076997d9fbc3dd1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.504691 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bb5e0cc0d64aa39076997d9fbc3dd1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.511552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bb5e0cc0d64aa39076997d9fbc3dd1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.512262 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bb5e0cc0d64aa39076997d9fbc3dd1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.512897 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c0e1d8cf-f076-4921-9851-37858ea50717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bb5e0cc0d64aa39076997d9fbc3dd1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:29.592414 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1356/2711] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:29 2022] DELETE /identity/v3/users/99bb5e0cc0d64aa39076997d9fbc3dd1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:30.085996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.087503 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:30.101443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d00f96-c08f-4065-af8f-4ee2de00c9e7 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.161950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.162819 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.163102 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.163380 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] PATH_INFO: `/v3/projects/f61b0d76563c4c5d8f3734e887e520c8` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.164566 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61b0d76563c4c5d8f3734e887e520c8)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.166545 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:30.255910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61b0d76563c4c5d8f3734e887e520c8', 'request_id': 'req-f53606ab-24b7-4a07-913c-032d33168773'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:30.299703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61b0d76563c4c5d8f3734e887e520c8', 'request_id': 'req-f53606ab-24b7-4a07-913c-032d33168773'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:30.305823 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61b0d76563c4c5d8f3734e887e520c8', 'request_id': 'req-f53606ab-24b7-4a07-913c-032d33168773'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:30.317140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] The token cache is being invalidate because project f61b0d76563c4c5d8f3734e887e520c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:30.319371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:30.319371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f53606ab-24b7-4a07-913c-032d33168773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:30.319780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1356/2712] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:30 2022] DELETE /identity/v3/projects/f61b0d76563c4c5d8f3734e887e520c8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:30.324767 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.325221 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.325367 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.342885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:30.344106 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:30.377719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:30.409932 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1357/2713] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:30.419647 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.419935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.420211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.427713 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:30.440342 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:30.441681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:30.450390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1357/2714] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:31:30.455899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.465655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13801a66-8b14-431a-aaa9-74f3d955ffe8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.470377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.471077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.471359 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.471636 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.472391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:31:30.473253 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.474902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:30.486514 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1358/2715] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:31:30.491604 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.505209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584f970-92bd-4dd7-9bb0-ca7b3f26e8a0 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.506703 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.507376 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.507661 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.507937 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.508634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.510671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:30.677257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1358/2716] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:30 2022] POST /identity/v3/projects => generated 389 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:30.678546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.689013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ba20-b471-4a72-ab21-97cbc61690d1 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.748357 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.749036 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.749365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.749629 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.750493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.756316 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:30.850308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1359/2717] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:30 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:30.854030 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.865408 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3380a38-ebc8-4b38-b44b-fdbf1e99212a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.870510 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.871240 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.871522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.871990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.872537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.874260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:30.888421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1359/2718] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:30.893185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.903815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead8a12-798f-424e-a655-1a3093e037f9 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.908410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e4a76-5329-4c66-a772-6d69ff69c2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.909079 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e4a76-5329-4c66-a772-6d69ff69c2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.909365 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e4a76-5329-4c66-a772-6d69ff69c2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.909650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e4a76-5329-4c66-a772-6d69ff69c2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.911256 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e4a76-5329-4c66-a772-6d69ff69c2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.912955 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e4a76-5329-4c66-a772-6d69ff69c2b7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:30.926319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1360/2719] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:30.930639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:30.940702 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c21b9-4dd0-4869-8416-e2049bb69958 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:30.945608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:30.946531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:30.946945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:30.947241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] PATH_INFO: `/v3/projects/5057b06fa81c4ca583d584c96442c2dc/users/b6b0d0196a5b4156b55c53c04f63c600/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:30.962606 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5057b06fa81c4ca583d584c96442c2dc, user_id=b6b0d0196a5b4156b55c53c04f63c600, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:30.965353 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:31.038720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1360/2720] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:30 2022] PUT /identity/v3/projects/5057b06fa81c4ca583d584c96442c2dc/users/b6b0d0196a5b4156b55c53c04f63c600/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:31:31.049208 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec13a6-5299-438a-ad58-eb999806151b None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:31.049711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec13a6-5299-438a-ad58-eb999806151b None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:31.050050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec13a6-5299-438a-ad58-eb999806151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:31.079341 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-7eec13a6-5299-438a-ad58-eb999806151b None None] MFA Rules not processed for user `b6b0d0196a5b4156b55c53c04f63c600`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:31.080564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-7eec13a6-5299-438a-ad58-eb999806151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:31.148505 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1361/2721] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:31.159212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:31.161440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:31.221438 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86bf3b-dfc5-47fe-b96a-0c66eeff721f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:31.225292 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:31.226069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:31.226282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:31.226593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:31.235270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:31.236749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:31.247719 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1361/2722] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:31.258082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:31.258489 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:31.258729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:31.277436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:31.278810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:31.307566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:31.337919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1362/2723] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:31.351914 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:31.353348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:31.424446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b764f-b888-4abb-a214-c11bb37e9c3d service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:31.429718 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc83daa-215b-41c0-848f-6e0ce0a2985b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:31.430437 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83daa-215b-41c0-848f-6e0ce0a2985b service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:31.430723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83daa-215b-41c0-848f-6e0ce0a2985b service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:31.431000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc83daa-215b-41c0-848f-6e0ce0a2985b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:31.439045 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc83daa-215b-41c0-848f-6e0ce0a2985b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:31.441298 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc83daa-215b-41c0-848f-6e0ce0a2985b service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:31.448632 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1362/2724] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:31:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:31:41.368795 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=11 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:41.445362 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:52.354634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:52.424013 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838900d-3556-49a3-948c-6dbd294a5d68 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:52.428881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:52.429828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:52.430183 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:52.430474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] PATH_INFO: `/v3/users/b6b0d0196a5b4156b55c53c04f63c600` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:52.431759 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b0d0196a5b4156b55c53c04f63c600)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:52.433697 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:52.636900 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b0d0196a5b4156b55c53c04f63c600'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:52.650137 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b0d0196a5b4156b55c53c04f63c600'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:52.657000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b0d0196a5b4156b55c53c04f63c600'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:52.657736 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b0d0196a5b4156b55c53c04f63c600'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:52.658378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b0d0196a5b4156b55c53c04f63c600'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:52.739539 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1363/2725] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:31:52 2022] DELETE /identity/v3/users/b6b0d0196a5b4156b55c53c04f63c600 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:52.744457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:52.744947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:52.745056 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:52.762681 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:52.763870 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:52.823390 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1363/2726] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:52.832862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:52.834967 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:52.891994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e2286-c493-4c10-ba8b-0cf24a2e7d29 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:52.895580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b805-7682-4cc2-9192-1ddaa9943210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:52.896855 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b805-7682-4cc2-9192-1ddaa9943210 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:52.897147 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b805-7682-4cc2-9192-1ddaa9943210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:52.897426 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b805-7682-4cc2-9192-1ddaa9943210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:52.906375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b805-7682-4cc2-9192-1ddaa9943210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:52.907830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1b805-7682-4cc2-9192-1ddaa9943210 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:52.917557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1364/2727] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:31:53.370555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:53.372116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:53.385260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c479c-485c-41f6-8852-1ed12f39cacd None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:53.390928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:53.392374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.392374 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.392541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] PATH_INFO: `/v3/projects/5057b06fa81c4ca583d584c96442c2dc` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.393675 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5057b06fa81c4ca583d584c96442c2dc)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:53.395668 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:53.431286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.431733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.432080 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.450190 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:53.451486 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:53.468830 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:53.507425 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1365/2728] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jun 20 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:31:53.519935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5057b06fa81c4ca583d584c96442c2dc', 'request_id': 'req-59a34157-828a-4f09-8404-bad6ea81cb21'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:53.531295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:53.532752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:53.606084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493d85a-2c99-45f6-b072-8d5638100a18 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:53.632137 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5057b06fa81c4ca583d584c96442c2dc', 'request_id': 'req-59a34157-828a-4f09-8404-bad6ea81cb21'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:53.639998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5057b06fa81c4ca583d584c96442c2dc', 'request_id': 'req-59a34157-828a-4f09-8404-bad6ea81cb21'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:53.653786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] The token cache is being invalidate because project 5057b06fa81c4ca583d584c96442c2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:31:53.654354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:53.655600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-59a34157-828a-4f09-8404-bad6ea81cb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:31:53.657068 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1364/2729] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:31:53 2022] DELETE /identity/v3/projects/5057b06fa81c4ca583d584c96442c2dc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:53.663724 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.664335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.671902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.672222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:53.672882 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.673314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.673602 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.675511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:53.694895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:53.696222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:53.738151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:53.740014 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccacfaa-aa01-4341-af00-eb1aa9311df8 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:53.750378 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1366/2730] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:31:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 12:31:53.763279 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1365/2731] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:53.770526 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.770880 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.771300 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.790593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:53.791856 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:53.800114 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1367/2732] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:53.804590 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:53.814756 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d536ca-3d25-46ee-bb72-f3ab893da83f None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:53.819421 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:53.820080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.820361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.825282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.825282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:31:53.825282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:53.825282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:53.835733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1366/2733] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:31:53.840171 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:53.847021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:53.851659 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ff72a-da51-48eb-80a1-eb6a821885e2 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:53.856337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:53.857090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:53.857375 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:53.857656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:53.858380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:53.860422 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:53.954912 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1368/2734] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:31:53 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:53.959954 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:53.970602 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e059c48-18ae-4931-b03e-f633d2845bbf admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:53.979260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:31:54.029560 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:54.030264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:54.030553 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:54.030836 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:54.031526 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:54.033457 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:54.113204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1367/2735] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:31:53 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:31:54.119259 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:54.129398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd04b2-64b9-4168-b413-0a34bd989368 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:54.134852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:54.135528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:54.135877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:54.141983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:54.141983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:54.141983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:54.150095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1369/2736] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:31:54.155921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:54.166364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d42f88-8e61-4054-a931-107ffa9fc48e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:54.171696 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286a02d-3c0d-4b95-a2d3-cf8060f96310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:54.172501 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286a02d-3c0d-4b95-a2d3-cf8060f96310 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:54.172735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286a02d-3c0d-4b95-a2d3-cf8060f96310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:54.172893 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286a02d-3c0d-4b95-a2d3-cf8060f96310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:54.173625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286a02d-3c0d-4b95-a2d3-cf8060f96310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:54.175273 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286a02d-3c0d-4b95-a2d3-cf8060f96310 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:54.189855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1368/2737] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:31:54.194915 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:54.206586 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969cab6-2f4e-4a49-85ec-456f8e533451 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:54.212218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:54.213232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:54.213508 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:54.213792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] PATH_INFO: `/v3/projects/53f261dd7f6040da958fd392d3eafba5/users/43d46de8bcad40428288fbc311125a08/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:54.230366 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f261dd7f6040da958fd392d3eafba5, user_id=43d46de8bcad40428288fbc311125a08, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:54.236906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:54.350843 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1370/2738] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:31:54 2022] PUT /identity/v3/projects/53f261dd7f6040da958fd392d3eafba5/users/43d46de8bcad40428288fbc311125a08/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:31:54.420004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:54.420300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:54.420586 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:54.449384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] MFA Rules not processed for user `43d46de8bcad40428288fbc311125a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:31:54.450664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:54.523612 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1369/2739] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:31:54.536587 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:31:54.538705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:31:54.607577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c581f8-eaa1-4283-a583-2386d2b07ea2 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:31:54.612632 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec70749-8fe5-4066-aee1-2b59820c4445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:31:54.613679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70749-8fe5-4066-aee1-2b59820c4445 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:31:54.614193 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70749-8fe5-4066-aee1-2b59820c4445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:31:54.614662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec70749-8fe5-4066-aee1-2b59820c4445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:31:54.626641 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec70749-8fe5-4066-aee1-2b59820c4445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:31:54.628115 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec70749-8fe5-4066-aee1-2b59820c4445 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:31:54.638260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1371/2740] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:31:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:32:03.736255 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:03.799749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f248b2-3f4a-4f28-9ec1-aae5dd2545ba None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:03.804189 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:03.805052 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:03.805331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:03.806680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] PATH_INFO: `/v3/users/43d46de8bcad40428288fbc311125a08` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:03.807877 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d46de8bcad40428288fbc311125a08)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:03.809792 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:03.831055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:03.995244 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d46de8bcad40428288fbc311125a08'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.006878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d46de8bcad40428288fbc311125a08'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.054722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d46de8bcad40428288fbc311125a08'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.055487 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d46de8bcad40428288fbc311125a08'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.064138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d46de8bcad40428288fbc311125a08'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.071515 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1370/2741] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:32:03 2022] DELETE /identity/v3/users/43d46de8bcad40428288fbc311125a08 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:32:04.075987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:04.076440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:04.076553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:04.093675 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:32:04.094908 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:04.154953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1372/2742] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:32:04.164593 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:04.166665 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:04.223583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f49d2-446e-4f00-89ee-89ae650c5192 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:04.227282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:04.227925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:04.228861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:04.229395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:04.238694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:04.240125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:04.250158 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1371/2743] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:32:04.644863 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:04.646535 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:04.659819 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa23183-9fad-494b-9812-25616e33a891 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:04.665573 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:04.666172 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:04.666598 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:04.666886 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] PATH_INFO: `/v3/projects/53f261dd7f6040da958fd392d3eafba5` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:04.668165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f261dd7f6040da958fd392d3eafba5)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:04.670536 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:04.784881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:04.787667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f261dd7f6040da958fd392d3eafba5', 'request_id': 'req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.794065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f261dd7f6040da958fd392d3eafba5', 'request_id': 'req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.799862 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f261dd7f6040da958fd392d3eafba5', 'request_id': 'req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.889189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] The token cache is being invalidate because project 53f261dd7f6040da958fd392d3eafba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:32:04.889480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.890121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-97e9e6fc-01b0-46d9-a6c1-c1c2a8722072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:32:04.891662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1373/2744] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:32:04 2022] DELETE /identity/v3/projects/53f261dd7f6040da958fd392d3eafba5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:32:09.585357 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:09.586745 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:09.643723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6bd3a-1c33-40e0-bc7f-06d7e8fac30a service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:09.695340 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:09.695991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:09.696277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:09.696555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:09.699061 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:09.709116 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:09.757257 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:09.758782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508dac-0d3c-4d97-b983-b40f6717fdf5 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:09.768523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1372/2745] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:32:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:32:14.969444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:18.321410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:18.322095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:18.322095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:18.340162 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] MFA Rules not processed for user `648c1ba14f1842a5b4160a7569e3206e`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:32:18.341350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:18.348334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1374/2746] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:32:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:32:19.980782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=22 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:28.334159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:40.130890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:40.131413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:40.131413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:40.148957 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] MFA Rules not processed for user `65f0d59c17874c949670e0e81c5b74f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:32:40.150384 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:40.206960 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1373/2747] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:32:50.199499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=25 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:32:51.843744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:51.845252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:51.903046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc8d7b-74e4-4108-b938-183e183e96ef None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:51.906938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:51.907580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:51.907874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:51.908154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:51.909939 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:51.986060 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:51.987594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ace685-0b64-4e15-a6d1-c2af50a5a4d9 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:51.998811 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1375/2748] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:32:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:32:54.362249 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:32:54.363808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:54.375944 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c08c5a-bbe5-4472-8b31-d8a6a63954ff None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:32:54.380399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:32:54.382620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:32:54.382620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:32:54.382620 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:32:54.383415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:32:54.397519 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:32:54.398987 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:32:54.410231 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1374/2749] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:33:01.993740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=54 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:04.405062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=6 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:33:52.369073 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:52.369607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:52.369772 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:52.387992 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:33:52.389388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:52.447583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1376/2750] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:33:52.619393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:33:52.620880 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:33:52.690469 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b75c-e058-4129-9a4e-bd18dc19d498 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:33:52.695581 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69fe04-429f-4e20-9bcb-40bdddb4b2bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:33:52.697711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69fe04-429f-4e20-9bcb-40bdddb4b2bb service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:33:52.697711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69fe04-429f-4e20-9bcb-40bdddb4b2bb service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:33:52.697711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69fe04-429f-4e20-9bcb-40bdddb4b2bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:33:52.706400 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69fe04-429f-4e20-9bcb-40bdddb4b2bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:33:52.707971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69fe04-429f-4e20-9bcb-40bdddb4b2bb service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:33:52.716965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1375/2751] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:33:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:02.440680 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=25 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:02.713929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=32 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:03.037432 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:03.047603 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f683995-e0e6-45c0-84bf-945f110d1789 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:03.051159 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:03.051792 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:03.052074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:03.052374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:03.054194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:03.063653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:03.065083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2c1eb-94be-44c7-904f-2537e286521b service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:03.073329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1377/2752] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:09.881623 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6576f-6a3c-4de8-93a1-5504931adf2c None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:09.882296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6576f-6a3c-4de8-93a1-5504931adf2c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:09.882296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6576f-6a3c-4de8-93a1-5504931adf2c None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:09.883638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1376/2753] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:34:09.889457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa5c36-2388-47be-a62d-14074a4bbefc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:09.889913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa5c36-2388-47be-a62d-14074a4bbefc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:09.890056 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa5c36-2388-47be-a62d-14074a4bbefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:09.908436 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-ccaa5c36-2388-47be-a62d-14074a4bbefc None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:34:09.911707 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-ccaa5c36-2388-47be-a62d-14074a4bbefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:09.918943 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1378/2754] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:34:09.930985 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6576f-6a3c-4de8-93a1-5504931adf2c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:09.932667 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1de6576f-6a3c-4de8-93a1-5504931adf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:09.991642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6576f-6a3c-4de8-93a1-5504931adf2c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:09.995055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe73d9-5f74-4bf3-83b6-95936e9aead3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a20f362695fa4fbdb685632d4369bf04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:09.995688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe73d9-5f74-4bf3-83b6-95936e9aead3 service glance] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:09.995969 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe73d9-5f74-4bf3-83b6-95936e9aead3 service glance] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:09.996241 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe73d9-5f74-4bf3-83b6-95936e9aead3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.007299 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe73d9-5f74-4bf3-83b6-95936e9aead3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:10.008723 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe73d9-5f74-4bf3-83b6-95936e9aead3 service glance] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:10.019642 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1377/2755] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:10.205443 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6aec0-31da-4ce1-a738-bcd4d839c499 None None] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.205762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6aec0-31da-4ce1-a738-bcd4d839c499 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.206077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6aec0-31da-4ce1-a738-bcd4d839c499 None None] PATH_INFO: `/` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.207470 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1379/2756] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:34:10.212335 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325107-21d5-4d52-84f6-27f1b0e4763e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.212631 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325107-21d5-4d52-84f6-27f1b0e4763e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.212915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46325107-21d5-4d52-84f6-27f1b0e4763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.251135 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-46325107-21d5-4d52-84f6-27f1b0e4763e None None] MFA Rules not processed for user `9cd68b65a3cb460e8d6dee6e7ea4f04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:34:10.252311 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-46325107-21d5-4d52-84f6-27f1b0e4763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:10.259072 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1378/2757] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:34:10.271591 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6aec0-31da-4ce1-a738-bcd4d839c499 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:10.283216 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6aec0-31da-4ce1-a738-bcd4d839c499 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:10.287025 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225be9fc-7884-488b-b70f-9b95563d9432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:10.287677 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be9fc-7884-488b-b70f-9b95563d9432 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.287962 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be9fc-7884-488b-b70f-9b95563d9432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.288243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225be9fc-7884-488b-b70f-9b95563d9432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.296731 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be9fc-7884-488b-b70f-9b95563d9432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:10.298480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225be9fc-7884-488b-b70f-9b95563d9432 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:10.306616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1380/2758] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:10.392073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ea51-58c2-45b3-9f6f-3f3899a2a4ab None None] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.392366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ea51-58c2-45b3-9f6f-3f3899a2a4ab None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.392676 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ea51-58c2-45b3-9f6f-3f3899a2a4ab None None] PATH_INFO: `/` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.394118 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1379/2759] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jun 20 12:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 12:34:10.399374 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.399666 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.399951 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.420046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] MFA Rules not processed for user `75c9161930b64f0e910a4a3323fa733a`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:34:10.421362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:10.431092 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1381/2760] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jun 20 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 12:34:10.441644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ea51-58c2-45b3-9f6f-3f3899a2a4ab None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:10.453412 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ea51-58c2-45b3-9f6f-3f3899a2a4ab None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:10.457080 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:10.457717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.458038 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.458323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.469907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:10.471365 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:10.482504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1380/2761] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:10.548642 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:10.550168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:10.618350 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982789-b54c-48dc-bd9d-4054cf3b8246 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:10.623919 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:10.624568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:10.624850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:10.625125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:10.626921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:10.639282 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:10.641049 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05beceff-2d72-4213-93e7-bc22d1aba49f service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:10.651232 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1382/2762] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:11.263698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:11.265111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:11.282955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543465a-f23b-49e9-b435-5fc1be79e6fa service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:11.289887 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:11.290548 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:11.291478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:11.291766 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:11.294238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:11.312336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:11.314070 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:11.329349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1381/2763] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:14.330520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:14.331017 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:14.331138 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:14.349845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:34:14.351077 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:14.360010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1383/2764] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jun 20 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:34:14.371730 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:14.384892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf5527-1859-4bca-a001-c724bf8639a7 service nova] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:14.390505 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f894c2-ab52-469b-b9a2-cfdc1fd25d27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:14.391162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f894c2-ab52-469b-b9a2-cfdc1fd25d27 service swift] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:14.391444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f894c2-ab52-469b-b9a2-cfdc1fd25d27 service swift] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:14.391720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f894c2-ab52-469b-b9a2-cfdc1fd25d27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:14.400733 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f894c2-ab52-469b-b9a2-cfdc1fd25d27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:14.403419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f894c2-ab52-469b-b9a2-cfdc1fd25d27 service swift] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:14.414476 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1382/2765] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:34:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:24.343771 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=53 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:24.409420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=53 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:28.835087 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:28.850485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c87766-bdea-4ad8-8a51-7c63a66d9bfc None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:28.856130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75c9161930b64f0e910a4a3323fa733a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:28.856861 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:28.857157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:28.857439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:28.859561 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:28.872123 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:28.874388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:28.886346 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1384/2766] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:31.851761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:31.852259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:31.852429 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:31.870996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] MFA Rules not processed for user `f5270f6d342b4ec08c27b7d8de8a0a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:34:31.872252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:31.880267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1383/2767] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jun 20 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:34:31.893793 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:31.905305 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812314-7103-403f-8fd6-a2e932666971 service nova] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:31.910318 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c26b297875b47bf8b14775b4fb63c9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:31.911031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:31.911315 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:31.911607 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:31.921419 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:31.923401 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:31.931684 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1385/2768] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jun 20 12:34:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 12:34:35.354817 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:35.364459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c2b37-3b51-44b0-86f5-621f99ca6bd4 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:35.368011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:35.368650 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:35.368934 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:35.369212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:35.371003 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:35.433363 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:35.434837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:35.444542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1384/2769] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:38.686266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:38.698082 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6950f-df3f-41bf-8ca3-eff7c0d07d86 service swift] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:38.705585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:38.706353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:38.706698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:38.707043 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:38.708878 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:38.721497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:38.723276 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:38.733747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1386/2770] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:34:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:34:42.650389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:42.657860 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:42.672383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79b6e-03d5-4612-9132-46a0432c9277 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:42.677343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:42.678259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:42.678541 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:42.678816 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] PATH_INFO: `/v3/users/648c1ba14f1842a5b4160a7569e3206e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:42.680004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648c1ba14f1842a5b4160a7569e3206e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:42.681955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:42.866388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648c1ba14f1842a5b4160a7569e3206e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:42.880086 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648c1ba14f1842a5b4160a7569e3206e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:42.946327 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648c1ba14f1842a5b4160a7569e3206e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:42.946949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648c1ba14f1842a5b4160a7569e3206e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:42.954340 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648c1ba14f1842a5b4160a7569e3206e'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:42.960266 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1385/2771] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:34:42 2022] DELETE /identity/v3/users/648c1ba14f1842a5b4160a7569e3206e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:34:43.208243 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:43.221910 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249b64f-a52a-4ccb-84f1-4665f942017a service placement] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:43.279570 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:43.280998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:43.281286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:43.281564 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] PATH_INFO: `/v3/projects/68f8e01a266c4737ad5fa510ed9b2fad` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:43.282812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f8e01a266c4737ad5fa510ed9b2fad)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:43.284753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:43.386388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f8e01a266c4737ad5fa510ed9b2fad', 'request_id': 'req-eb7dfbd7-7f36-4035-a224-3093a1945e24'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.392980 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f8e01a266c4737ad5fa510ed9b2fad', 'request_id': 'req-eb7dfbd7-7f36-4035-a224-3093a1945e24'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.398472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f8e01a266c4737ad5fa510ed9b2fad', 'request_id': 'req-eb7dfbd7-7f36-4035-a224-3093a1945e24'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.486111 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] The token cache is being invalidate because project 68f8e01a266c4737ad5fa510ed9b2fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:34:43.486402 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.487028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.488574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1387/2772] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:34:43 2022] DELETE /identity/v3/projects/68f8e01a266c4737ad5fa510ed9b2fad => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:34:43.492556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:43.493991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:43.507332 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ae7ee-e484-47e9-9e84-14fe29e02ee5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:43.562967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:43.563843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:43.564128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:43.564404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] PATH_INFO: `/v3/users/bd72844245aa4739af67c4aa66d7dd6f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:43.565600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd72844245aa4739af67c4aa66d7dd6f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:43.567570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:43.569040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:43.768996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd72844245aa4739af67c4aa66d7dd6f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.781204 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd72844245aa4739af67c4aa66d7dd6f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.866491 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd72844245aa4739af67c4aa66d7dd6f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.867140 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd72844245aa4739af67c4aa66d7dd6f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.874998 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd72844245aa4739af67c4aa66d7dd6f'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:43.880967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1386/2773] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:34:43 2022] DELETE /identity/v3/users/bd72844245aa4739af67c4aa66d7dd6f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:34:44.134026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:34:44.135460 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:34:44.149457 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7dfbd7-7f36-4035-a224-3093a1945e24 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:34:44.199399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:44.208978 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:34:44.209870 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:34:44.210154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:34:44.210429 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] PATH_INFO: `/v3/projects/3f51ecfadddc4a11a3c17d68f73a46cb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:34:44.211633 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f51ecfadddc4a11a3c17d68f73a46cb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:34:44.213531 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:34:44.330410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f51ecfadddc4a11a3c17d68f73a46cb', 'request_id': 'req-40529568-d6f7-4dc1-b31c-8a8e36395e25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:44.336679 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f51ecfadddc4a11a3c17d68f73a46cb', 'request_id': 'req-40529568-d6f7-4dc1-b31c-8a8e36395e25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:44.342185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f51ecfadddc4a11a3c17d68f73a46cb', 'request_id': 'req-40529568-d6f7-4dc1-b31c-8a8e36395e25'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:44.427504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] The token cache is being invalidate because project 3f51ecfadddc4a11a3c17d68f73a46cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:34:44.427794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:44.428400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:34:44.429953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1388/2774] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:34:44 2022] DELETE /identity/v3/projects/3f51ecfadddc4a11a3c17d68f73a46cb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:34:53.877414 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:34:54.423986 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:03.295425 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:03.296848 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:03.357026 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef70cd-af98-4c03-85cd-957b18f76977 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:03.408268 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:03.408924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:03.409212 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:03.409490 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:03.411927 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:03.472216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:03.473776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:03.484047 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1387/2775] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:11.143380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:11.144815 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:11.207931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40529568-d6f7-4dc1-b31c-8a8e36395e25 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:11.212391 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:11.213046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:11.213333 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:11.213608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:11.223118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:11.278846 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:11.280285 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:11.290299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1389/2776] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:13.478989 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=68 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:15.016250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:15.017782 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:15.099861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3c176-943b-479c-9fe1-bf7a16a0a101 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:15.104578 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:15.105625 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:15.105945 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:15.106226 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] PATH_INFO: `/v3/users/65f0d59c17874c949670e0e81c5b74f4` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:15.107486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f0d59c17874c949670e0e81c5b74f4)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:15.109435 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:15.343209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f0d59c17874c949670e0e81c5b74f4'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.355440 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f0d59c17874c949670e0e81c5b74f4'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.434847 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f0d59c17874c949670e0e81c5b74f4'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.435484 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f0d59c17874c949670e0e81c5b74f4'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.442673 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f641ba30-3197-49c9-89cf-e88e3393bc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f0d59c17874c949670e0e81c5b74f4'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.449246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1388/2777] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:15 2022] DELETE /identity/v3/users/65f0d59c17874c949670e0e81c5b74f4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:15.710610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:15.768057 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1e222-0b01-41d7-9cf7-9ae8fe5a6769 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:15.824146 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:15.825008 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:15.825293 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:15.825575 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] PATH_INFO: `/v3/projects/882feee6f30d4e52b8ab28f7e7193568` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:15.826787 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882feee6f30d4e52b8ab28f7e7193568)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:15.828694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:15.839838 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=100 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:15.961197 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882feee6f30d4e52b8ab28f7e7193568', 'request_id': 'req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.967848 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882feee6f30d4e52b8ab28f7e7193568', 'request_id': 'req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:15.973321 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882feee6f30d4e52b8ab28f7e7193568', 'request_id': 'req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.054286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] The token cache is being invalidate because project 882feee6f30d4e52b8ab28f7e7193568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:16.054580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.055996 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-e4edfbf7-7b80-4ee8-98d7-e34d7af81ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:16.057580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1390/2778] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:15 2022] DELETE /identity/v3/projects/882feee6f30d4e52b8ab28f7e7193568 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:16.062522 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.063021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.063145 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.091629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:16.092928 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:16.153478 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1389/2779] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:16.161894 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.162185 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.162462 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.183676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:16.184949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:16.192913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1391/2780] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:16.198950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.204981 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:16.208780 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921e41-9d87-4f9b-9bc6-b517f01ed297 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.214638 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.215223 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.215506 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.215781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.216499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:16.216803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.218486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.230783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1390/2781] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:16.235314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.244768 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46736333-b519-4c9c-8ba5-ac692a99e86f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.249515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.250202 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.250490 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.250769 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.251497 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.253544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.376889 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1392/2782] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/projects => generated 357 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:16.380841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.391393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509556e-1223-40ed-aec5-fa6e120d6b4a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.450179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.450858 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.451141 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.451419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.452124 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.454088 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.578992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1391/2783] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/users => generated 279 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:35:16.582805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.593708 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ffea5-fe08-41f8-b875-3a512267a200 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.598377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.599030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.599314 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.599590 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.600310 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.602095 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.612410 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1393/2784] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:16.616393 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.626735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e43be-eaee-4b9c-b17c-c09776bfd74b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.631537 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299c4c6-6e89-41ac-803f-edbcc67a425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.632195 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c4c6-6e89-41ac-803f-edbcc67a425e admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.632557 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c4c6-6e89-41ac-803f-edbcc67a425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.633517 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299c4c6-6e89-41ac-803f-edbcc67a425e admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.634571 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299c4c6-6e89-41ac-803f-edbcc67a425e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.636217 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299c4c6-6e89-41ac-803f-edbcc67a425e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.646328 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1392/2785] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 12:35:16.651015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.660727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ace1b-57b8-4eee-a990-0d0a5e65fe6d admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.665468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.666379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.666662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.666938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] PATH_INFO: `/v3/projects/ca0ffa87e0a74b16bc4dfaf20fe035ae/users/6897559874b24ac29fa9241b051275a8/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.681940 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0ffa87e0a74b16bc4dfaf20fe035ae, user_id=6897559874b24ac29fa9241b051275a8, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.684579 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:16.764794 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1394/2786] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:16 2022] PUT /identity/v3/projects/ca0ffa87e0a74b16bc4dfaf20fe035ae/users/6897559874b24ac29fa9241b051275a8/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:16.775513 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.775809 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.776095 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.802188 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] MFA Rules not processed for user `6897559874b24ac29fa9241b051275a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:16.803399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:16.865599 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1393/2787] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:16.870610 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:16.932298 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91add496-eeb4-44d7-bcf5-52672d3cecfc admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:16.937047 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:16.937702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:16.938021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:16.938299 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:16.938996 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:16.940903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.045116 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1395/2788] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:16 2022] POST /identity/v3/projects => generated 357 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:17.049391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.060918 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0d8e1-d353-4fa9-9a5c-b07d25699337 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.117143 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.118504 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.118687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.118967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.119674 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.121616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.128271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:17.192428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1394/2789] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:17 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:17.197445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.207968 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e25f8-44a7-4f7e-b041-02ac7d6abd6f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.212906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.213617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.213953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.214223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.214944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.216558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.227740 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1396/2790] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:17.232000 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.242067 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3688a-5c40-4524-8a2f-ad0b3ecf07e3 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.247498 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.248382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.248671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.248947 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] PATH_INFO: `/v3/projects/c0e48e1a22e1404780a34626a3501645/users/2df061e9ac1d425ca6dea28556633fd6/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.264054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e48e1a22e1404780a34626a3501645, user_id=2df061e9ac1d425ca6dea28556633fd6, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.266735 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.373259 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1395/2791] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:17 2022] PUT /identity/v3/projects/c0e48e1a22e1404780a34626a3501645/users/2df061e9ac1d425ca6dea28556633fd6/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:35:17.377167 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.387511 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1885e41-65b5-4327-a44f-047e4ee7b82f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.397063 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:17.448479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661d83e-9eb6-4980-b6ad-ca1dfe65fa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.486175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d83e-9eb6-4980-b6ad-ca1dfe65fa87 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.486175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d83e-9eb6-4980-b6ad-ca1dfe65fa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.486175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661d83e-9eb6-4980-b6ad-ca1dfe65fa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.486175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d83e-9eb6-4980-b6ad-ca1dfe65fa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.486175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661d83e-9eb6-4980-b6ad-ca1dfe65fa87 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.486175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1397/2792] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:17.489094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.500202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390ea1e-8392-45bd-9394-a6748e073c4b admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.504889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.505779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.506098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.506377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] PATH_INFO: `/v3/projects/c0e48e1a22e1404780a34626a3501645/users/2df061e9ac1d425ca6dea28556633fd6/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.508518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e48e1a22e1404780a34626a3501645, user_id=2df061e9ac1d425ca6dea28556633fd6, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.511186 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.521449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1396/2793] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:17 2022] PUT /identity/v3/projects/c0e48e1a22e1404780a34626a3501645/users/2df061e9ac1d425ca6dea28556633fd6/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:17.532476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.532931 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.533459 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.564339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] MFA Rules not processed for user `2df061e9ac1d425ca6dea28556633fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:17.565556 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:17.632888 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1398/2794] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:17.643973 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.645722 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:17.723624 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef22b6b2-edbf-4260-8b33-993612082507 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.728386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.729428 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.729925 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.730211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:17.739687 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:17.741142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:17.750701 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1397/2795] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:17.971196 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:17.981982 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ebf66-94cf-470c-a45f-2f1bb2837fe8 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:17.985520 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc13cf-06b2-43c3-8db7-32fae8b8e44c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:17.986195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc13cf-06b2-43c3-8db7-32fae8b8e44c service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:17.986482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc13cf-06b2-43c3-8db7-32fae8b8e44c service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:17.991553 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc13cf-06b2-43c3-8db7-32fae8b8e44c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:18.043949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc13cf-06b2-43c3-8db7-32fae8b8e44c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:18.045446 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc13cf-06b2-43c3-8db7-32fae8b8e44c service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:18.054845 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1399/2796] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:27.746460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:INSERT=5,keystone:SELECT=50 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:28.050673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=86 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:36.969878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:37.031841 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8753893-a46a-4b52-9b9f-2cdb90603f5a service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:37.036716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:37.037582 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:37.037909 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:37.038193 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] PATH_INFO: `/v3/users/6897559874b24ac29fa9241b051275a8` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:37.039409 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6897559874b24ac29fa9241b051275a8)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:37.041329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:37.343179 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6897559874b24ac29fa9241b051275a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:37.354814 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6897559874b24ac29fa9241b051275a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:37.450388 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6897559874b24ac29fa9241b051275a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:37.451094 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6897559874b24ac29fa9241b051275a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:37.458653 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6897559874b24ac29fa9241b051275a8'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:37.464826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1398/2797] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:36 2022] DELETE /identity/v3/users/6897559874b24ac29fa9241b051275a8 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:37.469466 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:37.469974 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:37.470084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:37.487468 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:37.488673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:37.547126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1400/2798] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:37.556895 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:37.558852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:37.635885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a38d3-8fae-42aa-a7b7-fef1f0a80316 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:37.640050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:37.640691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:37.640978 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:37.641254 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:37.650229 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:37.651671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:37.661048 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1399/2799] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:38.077070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:38.078588 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:38.091439 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a0edd-4f72-410e-b33d-61e05dcc7168 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:38.096200 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:38.097074 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:38.097361 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:38.097643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] PATH_INFO: `/v3/projects/ca0ffa87e0a74b16bc4dfaf20fe035ae` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:38.098906 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0ffa87e0a74b16bc4dfaf20fe035ae)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:38.100859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:38.229616 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0ffa87e0a74b16bc4dfaf20fe035ae', 'request_id': 'req-843353bf-d6be-464b-8253-e2ee23744691'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.236789 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0ffa87e0a74b16bc4dfaf20fe035ae', 'request_id': 'req-843353bf-d6be-464b-8253-e2ee23744691'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.242269 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0ffa87e0a74b16bc4dfaf20fe035ae', 'request_id': 'req-843353bf-d6be-464b-8253-e2ee23744691'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.336705 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] The token cache is being invalidate because project ca0ffa87e0a74b16bc4dfaf20fe035ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:38.336994 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.337638 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.339217 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1401/2800] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:38 2022] DELETE /identity/v3/projects/ca0ffa87e0a74b16bc4dfaf20fe035ae => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:38.344481 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:38.349449 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:38.354728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fef3ea-5720-4a42-8b10-1e9cc2e86285 service neutron] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:38.412285 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:38.413160 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:38.413447 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:38.413725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] PATH_INFO: `/v3/users/2df061e9ac1d425ca6dea28556633fd6` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:38.414955 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df061e9ac1d425ca6dea28556633fd6)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:38.416878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:38.645890 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df061e9ac1d425ca6dea28556633fd6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.658915 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df061e9ac1d425ca6dea28556633fd6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.751787 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df061e9ac1d425ca6dea28556633fd6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.752413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df061e9ac1d425ca6dea28556633fd6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.762418 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-ac095c61-4f2d-4852-ba52-1d6534eaa6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df061e9ac1d425ca6dea28556633fd6'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:38.768538 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1400/2801] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:38 2022] DELETE /identity/v3/users/2df061e9ac1d425ca6dea28556633fd6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:39.258842 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:39.260352 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:39.276475 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843353bf-d6be-464b-8253-e2ee23744691 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:39.339041 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:39.340218 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:39.340370 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:39.340612 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] PATH_INFO: `/v3/projects/c0e48e1a22e1404780a34626a3501645` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:39.341841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e48e1a22e1404780a34626a3501645)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:39.343802 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:39.487368 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:39.504062 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e48e1a22e1404780a34626a3501645', 'request_id': 'req-eef9114c-a867-401b-83e3-47b2ce65a836'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:39.510214 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e48e1a22e1404780a34626a3501645', 'request_id': 'req-eef9114c-a867-401b-83e3-47b2ce65a836'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:39.515899 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e48e1a22e1404780a34626a3501645', 'request_id': 'req-eef9114c-a867-401b-83e3-47b2ce65a836'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:39.581850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] The token cache is being invalidate because project c0e48e1a22e1404780a34626a3501645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80466) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:39.582154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:39.582778 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-eef9114c-a867-401b-83e3-47b2ce65a836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:39.584325 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1402/2802] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:39 2022] DELETE /identity/v3/projects/c0e48e1a22e1404780a34626a3501645 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:39.589159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:39.589686 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:39.589789 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:39.637222 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:39.638446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:39.689644 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:39.698992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1401/2803] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:39.706885 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:39.707182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:39.707471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:39.725953 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:39.727160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:39.735809 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1403/2804] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:39.739936 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:39.750315 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f32b-f9a1-46d6-b746-4ee6fd02ca3a None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:39.755822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:39.756446 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:39.756732 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:39.757014 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] PATH_INFO: `/v3/domains` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:39.757741 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80465) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:39.758083 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:39.759685 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:39.772382 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1402/2805] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:39.776783 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:39.786452 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15962f9a-dfe9-4747-bb0e-2e3745fc67f0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:39.791174 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:39.791812 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:39.792099 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:39.792369 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:39.793297 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:39.795275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:39.915997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1404/2806] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:39 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:39.922589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:39.932902 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df294bc-c1c5-49b1-8c6e-b9cbc9e63946 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:39.997069 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:39.997738 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:39.998058 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:39.998349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:39.999050 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.000971 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.077931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1403/2807] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:39 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:40.082222 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.092876 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f52385-bea6-47f8-82c6-a621ec1503e8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.097681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.098376 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.098667 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.098948 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.099676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.101319 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.112658 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1405/2808] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:40.116793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.127842 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ca7ff-680a-48e1-980e-9faf346339fc admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.132434 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474cec1-56b5-4aa7-9ab8-4a4fedb023ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.133081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474cec1-56b5-4aa7-9ab8-4a4fedb023ca admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.133360 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474cec1-56b5-4aa7-9ab8-4a4fedb023ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.133636 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474cec1-56b5-4aa7-9ab8-4a4fedb023ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.134379 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474cec1-56b5-4aa7-9ab8-4a4fedb023ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.136115 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474cec1-56b5-4aa7-9ab8-4a4fedb023ca admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.146810 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1404/2809] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:40.151187 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.161327 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d398a8f-6ce8-485a-8ad9-46ecc15346b0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.166075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.169003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.169003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.169003 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] PATH_INFO: `/v3/projects/8bc1bad467df44a38ae3e5e1f4a5183b/users/94152cd2ced048779cc33626f8f4ca9d/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.184655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bc1bad467df44a38ae3e5e1f4a5183b, user_id=94152cd2ced048779cc33626f8f4ca9d, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.187379 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.280902 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1406/2810] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:40 2022] PUT /identity/v3/projects/8bc1bad467df44a38ae3e5e1f4a5183b/users/94152cd2ced048779cc33626f8f4ca9d/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:40.291343 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.291637 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.291917 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.320194 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] MFA Rules not processed for user `94152cd2ced048779cc33626f8f4ca9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:40.321404 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:40.387879 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1405/2811] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:40.392423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.454719 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c519d6b-1997-4fd0-bf33-e49481a4869a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.459353 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.460006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.460295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.460574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] PATH_INFO: `/v3/projects` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.461260 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.463199 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.545148 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1407/2812] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:40 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:40.549355 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.560755 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f28f-7701-4fd5-b270-61025b89cc4e None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.608036 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:40.616567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.617233 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.617518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.617827 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] PATH_INFO: `/v3/users` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.618614 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.620550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.741318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1406/2813] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:40 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:40.745234 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.755704 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece88dbb-744a-469c-baf2-11cee73a241e admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.760433 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.761093 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.761380 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.761662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.763121 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.764729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.775356 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1408/2814] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:40.780583 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.790600 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc554f8-f68b-402a-9013-b2b0542e013d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.795278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.796206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.796482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.796758 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] PATH_INFO: `/v3/projects/a3acec6edfcb46efbba252a361c91949/users/991093df7921495a8964ed2f9fe3cf62/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.811757 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3acec6edfcb46efbba252a361c91949, user_id=991093df7921495a8964ed2f9fe3cf62, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.814444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:40.914721 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1407/2815] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:40 2022] PUT /identity/v3/projects/a3acec6edfcb46efbba252a361c91949/users/991093df7921495a8964ed2f9fe3cf62/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:40.918859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:40.929415 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ece223-5580-4f92-b839-aab09086824a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:40.948698 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:40.986334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9516d0-92a7-458f-b00b-46d0e355c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:40.987010 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9516d0-92a7-458f-b00b-46d0e355c556 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:40.987399 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9516d0-92a7-458f-b00b-46d0e355c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:40.987599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9516d0-92a7-458f-b00b-46d0e355c556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:40.988334 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9516d0-92a7-458f-b00b-46d0e355c556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:40.989965 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9516d0-92a7-458f-b00b-46d0e355c556 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:41.003268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1409/2816] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:41.004333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:41.015213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3ef83-74b4-45a7-bde3-572e7ad2127d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:41.019832 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:41.020711 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:41.020991 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:41.021267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] PATH_INFO: `/v3/projects/a3acec6edfcb46efbba252a361c91949/users/991093df7921495a8964ed2f9fe3cf62/roles/257fc562d022442fb5494f80168760bb` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:41.023389 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3acec6edfcb46efbba252a361c91949, user_id=991093df7921495a8964ed2f9fe3cf62, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:41.026041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:41.036843 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1408/2817] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:41 2022] PUT /identity/v3/projects/a3acec6edfcb46efbba252a361c91949/users/991093df7921495a8964ed2f9fe3cf62/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:41.047928 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:41.048224 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:41.048512 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:41.077182 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] MFA Rules not processed for user `991093df7921495a8964ed2f9fe3cf62`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:41.078484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:41.151291 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1410/2818] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:41.162693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:41.164371 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:41.223159 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bcbd3-f5c2-4425-800c-cc9d57eed16a admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:41.226830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfb78c-dddc-4cc6-a29d-8594dc8b6bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:41.227495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfb78c-dddc-4cc6-a29d-8594dc8b6bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:41.227783 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfb78c-dddc-4cc6-a29d-8594dc8b6bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:41.228065 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfb78c-dddc-4cc6-a29d-8594dc8b6bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:41.237403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfb78c-dddc-4cc6-a29d-8594dc8b6bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:41.238885 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfb78c-dddc-4cc6-a29d-8594dc8b6bb5 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:41.248929 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1409/2819] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:41.277871 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:41.339450 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50d8c7-98ec-460f-b3f4-706c7c45bfac None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:41.344130 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:41.344989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:41.345268 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:41.345540 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] PATH_INFO: `/v3/users/94152cd2ced048779cc33626f8f4ca9d` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:41.346762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94152cd2ced048779cc33626f8f4ca9d)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:41.348672 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:41.502701 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94152cd2ced048779cc33626f8f4ca9d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:41.503825 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:41.515766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94152cd2ced048779cc33626f8f4ca9d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:41.522413 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94152cd2ced048779cc33626f8f4ca9d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:41.523112 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94152cd2ced048779cc33626f8f4ca9d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:41.523738 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94152cd2ced048779cc33626f8f4ca9d'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:41.712567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1411/2820] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:41 2022] DELETE /identity/v3/users/94152cd2ced048779cc33626f8f4ca9d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:41.717200 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:41.717688 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:41.717793 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:41.735655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:41.736851 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:41.797084 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1410/2821] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:41.806995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:41.808411 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:41.866303 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871fe80-6bf0-49ea-9b3d-f9c340fdfad7 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:41.869881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:41.870594 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:41.870881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:41.871770 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:41.881110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:41.882592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:41.892201 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1412/2822] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:42.331261 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:42.332834 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:42.345326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e00fa9-d5f2-460a-ae60-872d0c0d1dec None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:42.350466 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:42.351383 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:42.351664 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:42.351941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] PATH_INFO: `/v3/projects/8bc1bad467df44a38ae3e5e1f4a5183b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:42.353138 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bc1bad467df44a38ae3e5e1f4a5183b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:42.355153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:42.458395 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:42.462290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bc1bad467df44a38ae3e5e1f4a5183b', 'request_id': 'req-98279888-b1e2-4617-95e4-eabdcd0352ef'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.571761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bc1bad467df44a38ae3e5e1f4a5183b', 'request_id': 'req-98279888-b1e2-4617-95e4-eabdcd0352ef'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.578555 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bc1bad467df44a38ae3e5e1f4a5183b', 'request_id': 'req-98279888-b1e2-4617-95e4-eabdcd0352ef'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.589924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] The token cache is being invalidate because project 8bc1bad467df44a38ae3e5e1f4a5183b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:42.590218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.590950 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.592512 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1411/2823] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:42 2022] DELETE /identity/v3/projects/8bc1bad467df44a38ae3e5e1f4a5183b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:42.596592 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:42.607002 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55678889-136a-4af4-b9cf-e85c76c389f3 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:42.665340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:42.666273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:42.666554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:42.666831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] PATH_INFO: `/v3/users/991093df7921495a8964ed2f9fe3cf62` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:42.668141 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991093df7921495a8964ed2f9fe3cf62)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:42.670713 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:42.897083 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991093df7921495a8964ed2f9fe3cf62'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.909921 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991093df7921495a8964ed2f9fe3cf62'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.914278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:42.917255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991093df7921495a8964ed2f9fe3cf62'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.917963 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991093df7921495a8964ed2f9fe3cf62'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.919907 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-7d98eb9f-101e-4a68-8f93-99efcabaa178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991093df7921495a8964ed2f9fe3cf62'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:42.997546 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1413/2824] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:42 2022] DELETE /identity/v3/users/991093df7921495a8964ed2f9fe3cf62 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:43.464990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:43.467114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:43.482559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279888-b1e2-4617-95e4-eabdcd0352ef admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:43.542302 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:43.543168 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:43.543460 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:43.544282 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] PATH_INFO: `/v3/projects/a3acec6edfcb46efbba252a361c91949` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:43.545470 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3acec6edfcb46efbba252a361c91949)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:43.547603 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:43.667110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3acec6edfcb46efbba252a361c91949', 'request_id': 'req-350adb3a-d62a-4170-930a-0a99114f1851'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:43.740641 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3acec6edfcb46efbba252a361c91949', 'request_id': 'req-350adb3a-d62a-4170-930a-0a99114f1851'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:43.746238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3acec6edfcb46efbba252a361c91949', 'request_id': 'req-350adb3a-d62a-4170-930a-0a99114f1851'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:43.757616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] The token cache is being invalidate because project a3acec6edfcb46efbba252a361c91949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:43.757949 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:43.758680 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-350adb3a-d62a-4170-930a-0a99114f1851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:43.760238 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1412/2825] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:43 2022] DELETE /identity/v3/projects/a3acec6edfcb46efbba252a361c91949 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:43.765944 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:43.766445 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:43.766558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:43.785349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:43.786583 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:43.845280 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1414/2826] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:43.853079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:43.853377 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:43.853660 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:43.871543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:43.872771 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:43.880671 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1413/2827] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:43.884746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:43.895524 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00195d0-5e56-4ac7-9f49-6f6b19dfbf3d None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:43.900084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:43.900714 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:43.900997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:43.901275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:43.902026 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:43.902335 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:43.904550 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:43.916273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1415/2828] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:43.920896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:43.930520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbff03-09b9-4f97-9910-b30559859cc2 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:43.935296 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:43.935951 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:43.936237 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:43.936520 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:43.937216 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:43.939401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.024556 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1414/2829] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:43 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:44.028640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:44.039484 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ad3d0-c3e6-422f-93d1-820532cd5398 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:44.097039 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:44.097741 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.098086 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.098388 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.099076 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:44.101033 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.229320 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1416/2830] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:44 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:44.233411 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:44.244010 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b7f72-de1e-4c1a-9fea-87fc336f17f4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:44.249277 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:44.249979 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.250267 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.250546 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.251314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:44.252968 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.264611 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1415/2831] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:44.268681 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:44.278922 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63464d0d-b3cc-47a6-bdb2-4d348261852a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:44.283548 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b20f13-4603-4005-90f1-754f586f5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:44.284206 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b20f13-4603-4005-90f1-754f586f5a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.284500 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b20f13-4603-4005-90f1-754f586f5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.284780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b20f13-4603-4005-90f1-754f586f5a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.285504 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b20f13-4603-4005-90f1-754f586f5a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:44.287189 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b20f13-4603-4005-90f1-754f586f5a12 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.297295 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1417/2832] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:44.301518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:44.312554 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434eb0b-fb9b-4b40-89ef-16431161ffc5 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:44.317054 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:44.317963 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.318247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.318525 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] PATH_INFO: `/v3/projects/e7432f116e20426ab4721d683c59fd6b/users/b82acce86cc54ef6b7f4c095d6529733/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.333761 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7432f116e20426ab4721d683c59fd6b, user_id=b82acce86cc54ef6b7f4c095d6529733, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:44.336413 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.444479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:44.451114 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1416/2833] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:44 2022] PUT /identity/v3/projects/e7432f116e20426ab4721d683c59fd6b/users/b82acce86cc54ef6b7f4c095d6529733/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:44.461393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.461694 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.462021 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.489050 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] MFA Rules not processed for user `b82acce86cc54ef6b7f4c095d6529733`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:44.490279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:44.532434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:44.555656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1418/2834] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:44.568183 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:44.569903 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:44.627965 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1657645-b4fa-4e0a-925f-0d1ebe6b393f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:44.631768 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d63b28-4f0b-4ce1-a73b-8813e1a0c35d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:44.632419 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d63b28-4f0b-4ce1-a73b-8813e1a0c35d service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.632704 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d63b28-4f0b-4ce1-a73b-8813e1a0c35d service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.633098 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d63b28-4f0b-4ce1-a73b-8813e1a0c35d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.642062 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d63b28-4f0b-4ce1-a73b-8813e1a0c35d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:44.643499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d63b28-4f0b-4ce1-a73b-8813e1a0c35d service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.652536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1417/2835] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:44.678180 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:44.740720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c46f4-6d48-488e-af0c-8a62386684ed None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:44.745324 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:44.746225 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:44.746515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:44.746797 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] PATH_INFO: `/v3/users/b82acce86cc54ef6b7f4c095d6529733` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:44.748628 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82acce86cc54ef6b7f4c095d6529733)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:44.750613 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:44.931954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82acce86cc54ef6b7f4c095d6529733'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:44.944175 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82acce86cc54ef6b7f4c095d6529733'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:44.951165 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82acce86cc54ef6b7f4c095d6529733'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:44.951859 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82acce86cc54ef6b7f4c095d6529733'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:44.952482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82acce86cc54ef6b7f4c095d6529733'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:45.020264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1419/2836] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:44 2022] DELETE /identity/v3/users/b82acce86cc54ef6b7f4c095d6529733 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:45.025122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:45.025459 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:45.025779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:45.043613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:45.044808 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:45.104041 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1418/2837] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:45.114377 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:45.115762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:45.173543 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2c49b-df43-46f7-8e0f-c86444f797dd admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:45.177599 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86b2a6-ab22-401c-a44e-b4ba6c4384aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:45.178266 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b2a6-ab22-401c-a44e-b4ba6c4384aa service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:45.178552 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b2a6-ab22-401c-a44e-b4ba6c4384aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:45.178831 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86b2a6-ab22-401c-a44e-b4ba6c4384aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:45.188275 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86b2a6-ab22-401c-a44e-b4ba6c4384aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:45.189647 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86b2a6-ab22-401c-a44e-b4ba6c4384aa service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:45.199195 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1420/2838] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:45.635889 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:45.637387 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:45.650110 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb6ad1-71a2-40a9-9116-1dcc6b68399c None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:45.655367 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:45.656281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:45.656570 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:45.656852 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] PATH_INFO: `/v3/projects/e7432f116e20426ab4721d683c59fd6b` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:45.658152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7432f116e20426ab4721d683c59fd6b)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:45.660077 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:45.763306 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7432f116e20426ab4721d683c59fd6b', 'request_id': 'req-5745df21-5fb1-445c-90ee-4899aeaf9065'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:45.831710 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7432f116e20426ab4721d683c59fd6b', 'request_id': 'req-5745df21-5fb1-445c-90ee-4899aeaf9065'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:45.837455 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7432f116e20426ab4721d683c59fd6b', 'request_id': 'req-5745df21-5fb1-445c-90ee-4899aeaf9065'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:45.848697 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] The token cache is being invalidate because project e7432f116e20426ab4721d683c59fd6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:45.848992 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:45.849626 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-5745df21-5fb1-445c-90ee-4899aeaf9065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:45.851206 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1419/2839] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:45 2022] DELETE /identity/v3/projects/e7432f116e20426ab4721d683c59fd6b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:45.856058 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:45.858630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:45.858630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:45.864515 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:45.875904 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:45.877150 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:45.935954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1421/2840] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:45.945495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:45.945910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:45.946236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:45.964613 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:45.965854 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:45.974283 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1420/2841] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:45.978544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:45.989005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb00918-0be1-449c-b6d4-405de01f983e None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:45.993686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:45.994384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:45.994673 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:45.994954 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:45.995685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:45.995997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:45.997609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.009867 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1422/2842] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:46.014209 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:46.023881 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293507f-99b2-4cf4-962d-549dad5167a7 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:46.028747 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:46.029423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.029709 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.030011 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.030693 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:46.033197 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.048468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:46.139907 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1421/2843] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:46 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:46.141431 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:46.152278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a7b6a-b595-4963-bb3e-b654621b863f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:46.210566 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:46.211286 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.211577 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.211860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.212567 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:46.214645 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.360850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1423/2844] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:46 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:46.364993 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:46.375260 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea779cc-1d79-45e0-bacf-13a1ae170cf1 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:46.379900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:46.382591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.382591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.382591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.382591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:46.385272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.397107 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1422/2845] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:46.401250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:46.412841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1133c5-03f7-4587-b332-d16a0c276b69 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:46.417785 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a9f0-9110-40df-bced-23d9ba645216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:46.418495 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a9f0-9110-40df-bced-23d9ba645216 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.418852 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a9f0-9110-40df-bced-23d9ba645216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.419075 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a9f0-9110-40df-bced-23d9ba645216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.419844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455a9f0-9110-40df-bced-23d9ba645216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:46.422194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455a9f0-9110-40df-bced-23d9ba645216 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.432650 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1424/2846] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:46.436797 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:46.446796 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293977c4-ccc7-4561-bd2d-81ce792f9dcc admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:46.451331 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:46.452232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.452518 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.452850 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] PATH_INFO: `/v3/projects/4398bc9694464455a028f456c3911e33/users/06ae337901e74f3ea417fd621401a4d2/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.467348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4398bc9694464455a028f456c3911e33, user_id=06ae337901e74f3ea417fd621401a4d2, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:46.470855 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.549170 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1423/2847] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:46 2022] PUT /identity/v3/projects/4398bc9694464455a028f456c3911e33/users/06ae337901e74f3ea417fd621401a4d2/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:46.559396 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.559690 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.559979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.587434 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] MFA Rules not processed for user `06ae337901e74f3ea417fd621401a4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:46.588643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:46.648084 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:46.651634 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1425/2848] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:46.662924 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:46.664655 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:46.723358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06074cff-0830-4567-b525-8882449ce88f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:46.727081 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64765a6a-c54c-4085-8074-c67fb5e61216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:46.727725 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64765a6a-c54c-4085-8074-c67fb5e61216 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:46.728009 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64765a6a-c54c-4085-8074-c67fb5e61216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:46.728284 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64765a6a-c54c-4085-8074-c67fb5e61216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:46.736572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64765a6a-c54c-4085-8074-c67fb5e61216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:46.738034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64765a6a-c54c-4085-8074-c67fb5e61216 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:46.746967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1424/2849] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:55.856807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:55.916593 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96588d-1d59-47a4-9652-0a7d6ce6dcd0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:55.921059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:55.921959 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:55.922247 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:55.922559 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] PATH_INFO: `/v3/users/06ae337901e74f3ea417fd621401a4d2` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:55.923753 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ae337901e74f3ea417fd621401a4d2)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:55.926035 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:56.097071 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ae337901e74f3ea417fd621401a4d2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.109104 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ae337901e74f3ea417fd621401a4d2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.116585 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ae337901e74f3ea417fd621401a4d2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.117258 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ae337901e74f3ea417fd621401a4d2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.117892 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ae337901e74f3ea417fd621401a4d2'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:56.220828 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1426/2850] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:55 2022] DELETE /identity/v3/users/06ae337901e74f3ea417fd621401a4d2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:56.226346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:56.226839 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:56.226961 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:56.245290 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:56.246514 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:56.305300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1425/2851] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:56.314730 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:56.316157 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:56.374015 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef2616-a087-469f-b89d-13d068e00235 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:56.377617 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eceed9f-22d0-46bc-9512-9ea34295657b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:56.378362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceed9f-22d0-46bc-9512-9ea34295657b service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:56.378568 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceed9f-22d0-46bc-9512-9ea34295657b service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:56.378850 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceed9f-22d0-46bc-9512-9ea34295657b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:56.387905 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eceed9f-22d0-46bc-9512-9ea34295657b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:56.389382 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eceed9f-22d0-46bc-9512-9ea34295657b service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:56.399491 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1427/2852] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:56.861997 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:56.863427 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:56.876482 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bc6a7-453e-413f-a4c7-8757b571a49d None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:56.881788 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:56.882749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:56.883031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:56.883347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] PATH_INFO: `/v3/projects/4398bc9694464455a028f456c3911e33` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:56.884634 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4398bc9694464455a028f456c3911e33)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:56.886726 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.016142 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4398bc9694464455a028f456c3911e33', 'request_id': 'req-c0b80fc0-b11c-4cdd-9966-94b929522a8b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.080572 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4398bc9694464455a028f456c3911e33', 'request_id': 'req-c0b80fc0-b11c-4cdd-9966-94b929522a8b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.083063 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:57.087878 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4398bc9694464455a028f456c3911e33', 'request_id': 'req-c0b80fc0-b11c-4cdd-9966-94b929522a8b'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.099364 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] The token cache is being invalidate because project 4398bc9694464455a028f456c3911e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:57.099759 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.100433 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-c0b80fc0-b11c-4cdd-9966-94b929522a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:57.102097 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1426/2853] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:56 2022] DELETE /identity/v3/projects/4398bc9694464455a028f456c3911e33 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:57.107580 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.108081 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.108480 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.128383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:57.129620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:57.152384 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:57.197916 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1428/2854] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:57.207497 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.208021 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.208567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.229336 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:57.230776 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:57.239608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1427/2855] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:57.245069 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.257637 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924515bf-893d-49d0-971f-d88f180a3f0f None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.262555 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.263233 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.263522 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.263807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.264562 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:57.264874 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.266544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.279397 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1429/2856] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 12:35:57.290386 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.301658 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d3483-310c-41e6-901a-fae69823c9a1 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.309399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.310113 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.310403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.310683 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.311401 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.313323 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.399754 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1428/2857] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:57 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:57.402313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.414059 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabc76-c30d-41f2-8f87-ae74ffb3107a admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.476007 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.476686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.476975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.477255 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.478005 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.480052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.590070 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1430/2858] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:57 2022] POST /identity/v3/users => generated 281 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:57.595291 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.609923 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec1e14-1451-4f92-ad16-02c89960337f admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.614910 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.615608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.615943 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.616278 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.617024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.618708 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.629396 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1429/2859] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:57.637676 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.648545 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b44ed-2f3b-4e7e-a811-79cf4c8039d8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.654226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc9884-f6c5-4801-afeb-491cc997d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.654942 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc9884-f6c5-4801-afeb-491cc997d12b admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.655471 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc9884-f6c5-4801-afeb-491cc997d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.656006 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc9884-f6c5-4801-afeb-491cc997d12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.656766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc9884-f6c5-4801-afeb-491cc997d12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.659702 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc9884-f6c5-4801-afeb-491cc997d12b admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.672117 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1431/2860] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:57.678263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:57.690874 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b7ac2-5cfc-4afe-80de-a9d27fa5b03c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:57.698103 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:57.698990 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.699272 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.699547 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] PATH_INFO: `/v3/projects/c672ebce58ef457a950607191bc80ac6/users/fa98968c2ae44ea18e9a87d95dc9c2b1/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.719288 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c672ebce58ef457a950607191bc80ac6, user_id=fa98968c2ae44ea18e9a87d95dc9c2b1, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:57.722162 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:57.828996 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1430/2861] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:57 2022] PUT /identity/v3/projects/c672ebce58ef457a950607191bc80ac6/users/fa98968c2ae44ea18e9a87d95dc9c2b1/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:57.897028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:57.897323 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:57.897609 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:57.927152 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] MFA Rules not processed for user `fa98968c2ae44ea18e9a87d95dc9c2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:57.928985 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:57.994290 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1432/2862] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:58.026055 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:58.027752 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:58.107803 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff279-83a6-4aba-a8aa-78f328a7a05e admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:58.111532 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cd447-a730-4170-853b-6d4c7e975aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:58.112181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cd447-a730-4170-853b-6d4c7e975aab service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.112468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cd447-a730-4170-853b-6d4c7e975aab service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.112746 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cd447-a730-4170-853b-6d4c7e975aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.121684 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cd447-a730-4170-853b-6d4c7e975aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:58.123205 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cd447-a730-4170-853b-6d4c7e975aab service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:58.132921 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1431/2863] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:58.147715 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:58.177312 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:58.222223 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa57942-43d0-4d35-8583-02d84e7b0730 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:58.235281 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:58.236168 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.236810 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.237126 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] PATH_INFO: `/v3/users/fa98968c2ae44ea18e9a87d95dc9c2b1` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.238363 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa98968c2ae44ea18e9a87d95dc9c2b1)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:58.241430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:58.405474 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa98968c2ae44ea18e9a87d95dc9c2b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.417975 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa98968c2ae44ea18e9a87d95dc9c2b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.424692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa98968c2ae44ea18e9a87d95dc9c2b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.426752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa98968c2ae44ea18e9a87d95dc9c2b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.426752 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa98968c2ae44ea18e9a87d95dc9c2b1'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:58.519733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1433/2864] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:35:58 2022] DELETE /identity/v3/users/fa98968c2ae44ea18e9a87d95dc9c2b1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:58.524716 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250fd59-4f64-448b-8489-366410085b49 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.525247 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250fd59-4f64-448b-8489-366410085b49 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.525366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250fd59-4f64-448b-8489-366410085b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.543334 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-b250fd59-4f64-448b-8489-366410085b49 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:58.544531 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b250fd59-4f64-448b-8489-366410085b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:58.603123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1432/2865] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:58.612630 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:58.614091 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:58.671805 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb424-b9a4-47f8-8646-1ed1f44bbbe0 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:58.675790 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52dcb89-4d0d-4251-aca0-f7454686a106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:58.676478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dcb89-4d0d-4251-aca0-f7454686a106 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:58.676765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dcb89-4d0d-4251-aca0-f7454686a106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:58.677044 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dcb89-4d0d-4251-aca0-f7454686a106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:58.686308 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dcb89-4d0d-4251-aca0-f7454686a106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:58.687766 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52dcb89-4d0d-4251-aca0-f7454686a106 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:58.697210 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1434/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:35:59.105074 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250fd59-4f64-448b-8489-366410085b49 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.106567 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-b250fd59-4f64-448b-8489-366410085b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:59.119043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250fd59-4f64-448b-8489-366410085b49 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.123779 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.124888 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.125024 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.125297 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] PATH_INFO: `/v3/projects/c672ebce58ef457a950607191bc80ac6` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.126523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c672ebce58ef457a950607191bc80ac6)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.128467 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.130163 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:59.264127 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c672ebce58ef457a950607191bc80ac6', 'request_id': 'req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:59.342639 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c672ebce58ef457a950607191bc80ac6', 'request_id': 'req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:59.348463 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c672ebce58ef457a950607191bc80ac6', 'request_id': 'req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:59.360309 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] The token cache is being invalidate because project c672ebce58ef457a950607191bc80ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:35:59.360601 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:59.361236 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-f2d8b1bc-dfee-441d-a67e-43a3b90e6771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:35:59.362826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1433/2867] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:35:59 2022] DELETE /identity/v3/projects/c672ebce58ef457a950607191bc80ac6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:35:59.367903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.368383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.368544 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.386479 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:59.387686 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:59.423151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:35:59.447747 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1435/2868] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:59.455246 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.455544 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.455824 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.474995 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:35:59.476416 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:35:59.484369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1434/2869] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:35:59.492151 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.501979 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7a7b2-2a19-423f-8af3-3ef3c6d7b97c None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.506780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.507463 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.507971 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.508750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.509901 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80466) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 12:35:59.510608 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.512364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.524345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1436/2870] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jun 20 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 12:35:59.528579 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.538589 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22dd10f-5ed2-4cea-9108-6741a701d076 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.543286 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.543935 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.544221 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.544499 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.545201 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.547144 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.641403 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1435/2871] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:35:59.645668 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.657055 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bb160-4d57-447e-b13a-0d9cf4f88e16 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.714279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.714946 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.715229 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.715506 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.716194 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.718133 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.809485 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1437/2872] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 12:35:59.813873 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.825076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68b08c-30a4-40b6-82d2-f53418f5f1d9 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.829770 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.830772 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.831152 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.831495 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.832252 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.834533 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.845263 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1436/2873] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:59.849476 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.859654 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd39c-5d00-4648-a84e-fe5260c4c3fd admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.864307 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e36caa-388c-4b03-a8c4-ee4abd3c745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.864995 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e36caa-388c-4b03-a8c4-ee4abd3c745d admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.865278 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e36caa-388c-4b03-a8c4-ee4abd3c745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.865558 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e36caa-388c-4b03-a8c4-ee4abd3c745d admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.866329 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e36caa-388c-4b03-a8c4-ee4abd3c745d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.867934 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e36caa-388c-4b03-a8c4-ee4abd3c745d admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.877727 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1438/2874] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:35:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:35:59.882210 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:35:59.892415 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376329a0-55bf-4523-8e94-d2f818c11250 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:35:59.897853 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:35:59.898762 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.899040 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.899314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] PATH_INFO: `/v3/projects/8e5d25e7f10e496c84da9c18c9a0713e/users/a281ef48919f4cd7bb2a1cd8b92f02bc/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:35:59.914122 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5d25e7f10e496c84da9c18c9a0713e, user_id=a281ef48919f4cd7bb2a1cd8b92f02bc, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:35:59.916749 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:35:59.985781 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1437/2875] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:35:59 2022] PUT /identity/v3/projects/8e5d25e7f10e496c84da9c18c9a0713e/users/a281ef48919f4cd7bb2a1cd8b92f02bc/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 12:35:59.996181 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:35:59.996478 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:35:59.996765 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.024412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] MFA Rules not processed for user `a281ef48919f4cd7bb2a1cd8b92f02bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:00.025604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:00.090807 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1439/2876] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:00.095232 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.156608 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9636f-dce2-4961-9f8b-09b5dc61b2c4 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.161218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.161911 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.162202 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.162479 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.163174 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.165093 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.304861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1438/2877] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:00 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:00.308998 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.320403 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183681ba-01b4-4c40-a770-49e78f56b7c0 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.352351 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:00.376028 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.376695 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.376987 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.377264 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.377988 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.379925 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.451983 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1440/2878] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:00 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:00.455523 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.466869 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f380fe-cb90-4fa3-87e4-aa6fc5f45695 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.471480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.472125 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.472420 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.472698 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.473426 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.475270 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.480443 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:00.486001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1439/2879] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:00.496250 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.506750 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d1f14-e5f2-4f03-a7c0-ccbfcddaec8f admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.511311 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264484f-ed90-421a-8131-04b3c1c336eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.511964 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264484f-ed90-421a-8131-04b3c1c336eb admin admin] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.512251 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264484f-ed90-421a-8131-04b3c1c336eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.512532 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264484f-ed90-421a-8131-04b3c1c336eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.513289 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264484f-ed90-421a-8131-04b3c1c336eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.514913 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264484f-ed90-421a-8131-04b3c1c336eb admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.525492 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1441/2880] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:00.530717 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.541128 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5e67a-afcd-401c-97a9-a08c069626bc admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.545896 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.546794 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.547079 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.547354 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] PATH_INFO: `/v3/projects/6f3c6682c5e0465a9dd05e92102e9795/users/a8ef77f4779c4a83a515945427027964/roles/dee54d96dbc846328f01f51027d2178f` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.562271 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3c6682c5e0465a9dd05e92102e9795, user_id=a8ef77f4779c4a83a515945427027964, role_id=dee54d96dbc846328f01f51027d2178f)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.565861 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.666480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1440/2881] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:00 2022] PUT /identity/v3/projects/6f3c6682c5e0465a9dd05e92102e9795/users/a8ef77f4779c4a83a515945427027964/roles/dee54d96dbc846328f01f51027d2178f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:00.678364 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.679733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.679733 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.705611 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.auth.core [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] MFA Rules not processed for user `a8ef77f4779c4a83a515945427027964`. Rule list: `[]` (Enabled: `True`). {{(pid=80466) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:00.706860 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:00.770866 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1442/2882] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:00.776090 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.837739 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbbaa0-ed44-44b2-b11f-ff288a6a3e6c admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:00.842610 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:00.843264 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:00.843550 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:00.843830 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:00.844536 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:00.846480 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:00.973235 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1441/2883] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jun 20 12:36:00 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:00.977604 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:00.988574 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f8d97-55fb-474e-aa0b-ad8d68d9afc7 None None] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:01.046313 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:01.046984 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] REQUEST_METHOD: `POST` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.047273 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.047554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] PATH_INFO: `/v3/users` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.048244 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:01.050482 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:01.141031 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1443/2884] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jun 20 12:36:00 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 12:36:01.145043 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:01.155838 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379bab8-6cb8-4533-9397-a6f017bb5015 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:01.160912 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:01.162153 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.162543 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.162826 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.163569 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:01.165177 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:01.176591 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1442/2885] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:01.181557 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:01.191692 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201eee3-2c5e-4faa-83df-a2fd3d03e651 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:01.196669 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:01.197541 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.197844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.198118 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] PATH_INFO: `/v3/projects/06fcb71d71b84b68bca1291d514e7b3a/users/71fd85d3ddc64195bb501f0a39df32c6/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.213213 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fcb71d71b84b68bca1291d514e7b3a, user_id=71fd85d3ddc64195bb501f0a39df32c6, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:01.215938 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:01.278398 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1444/2886] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:01 2022] PUT /identity/v3/projects/06fcb71d71b84b68bca1291d514e7b3a/users/71fd85d3ddc64195bb501f0a39df32c6/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:01.282477 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:01.293542 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084f2d9-ad9b-4e0b-8e75-c6b100b5d14d admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:01.356031 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71459-721f-4803-84dd-3c2543d56d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:01.356694 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71459-721f-4803-84dd-3c2543d56d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.356976 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71459-721f-4803-84dd-3c2543d56d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.357250 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71459-721f-4803-84dd-3c2543d56d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.358004 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71459-721f-4803-84dd-3c2543d56d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:01.359629 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71459-721f-4803-84dd-3c2543d56d83 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:01.370318 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1443/2887] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jun 20 12:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 12:36:01.374493 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:01.385386 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6736-2f25-4204-92a9-e13d8b60a237 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:01.389989 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:01.390868 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.391160 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.391441 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] PATH_INFO: `/v3/projects/06fcb71d71b84b68bca1291d514e7b3a/users/71fd85d3ddc64195bb501f0a39df32c6/roles/257fc562d022442fb5494f80168760bb` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.393392 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06fcb71d71b84b68bca1291d514e7b3a, user_id=71fd85d3ddc64195bb501f0a39df32c6, role_id=257fc562d022442fb5494f80168760bb)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:01.396279 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:01.399442 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:01.406956 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1445/2888] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jun 20 12:36:01 2022] PUT /identity/v3/projects/06fcb71d71b84b68bca1291d514e7b3a/users/71fd85d3ddc64195bb501f0a39df32c6/roles/257fc562d022442fb5494f80168760bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:01.418075 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.418369 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.418649 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.445423 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] MFA Rules not processed for user `71fd85d3ddc64195bb501f0a39df32c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:01.446652 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:01.480215 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:01.515326 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1444/2889] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:01.527881 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:01.529656 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:01.587328 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e072e-0cea-4b69-842a-88cb838894b8 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:01.591404 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:01.592053 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:01.592339 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:01.592620 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:01.648337 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:01.649788 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:01.658762 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1446/2890] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:03.501349 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:03.502812 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:03.515705 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36212db-8508-47d0-90d4-3c08df41c764 None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:03.519486 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:03.520172 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:03.520458 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:03.520738 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:03.579181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:03.580643 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:03.590391 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1445/2891] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:05.119345 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:05.128048 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650cb20-f152-4c92-9c08-2574255f0b44 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:05.132804 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4761c5c956f84b15a76074531901c462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:05.133440 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:05.133722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:05.134030 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:05.143125 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:05.144521 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:05.155101 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1447/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:07.258897 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:07.260300 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:07.351046 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d726b5-565d-43d7-9cba-0f2b1f5d2135 service cinder] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:07.356123 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:07.356800 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] REQUEST_METHOD: `GET` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:07.357087 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:07.357366 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:07.359274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:07.370899 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:07.372489 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c5aeb-1395-486a-b966-bb59262e2970 service placement] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:07.383474 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1446/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:09.809643 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:09.872046 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708adff-4c85-4645-8e10-1158933b4955 service cinder] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:09.876549 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:09.877412 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:09.877722 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:09.878027 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] PATH_INFO: `/v3/users/a281ef48919f4cd7bb2a1cd8b92f02bc` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:09.879204 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a281ef48919f4cd7bb2a1cd8b92f02bc)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:09.881528 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:10.094533 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:10.101622 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a281ef48919f4cd7bb2a1cd8b92f02bc'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:10.113655 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a281ef48919f4cd7bb2a1cd8b92f02bc'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:10.121052 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a281ef48919f4cd7bb2a1cd8b92f02bc'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:10.121729 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a281ef48919f4cd7bb2a1cd8b92f02bc'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:10.122362 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a281ef48919f4cd7bb2a1cd8b92f02bc'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:10.212110 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1448/2894] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:09 2022] DELETE /identity/v3/users/a281ef48919f4cd7bb2a1cd8b92f02bc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:10.216670 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] REQUEST_METHOD: `POST` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:10.217155 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:10.217281 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:10.234728 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.auth.core [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] MFA Rules not processed for user `c92fa328437c4093a3eddeda8c856c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80465) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 12:36:10.235941 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:10.269392 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=100 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:10.294938 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1447/2895] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jun 20 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 12:36:10.305923 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:10.307393 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:10.366444 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa13530-2916-46bf-bb5e-8053e9b25322 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:10.370020 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd68b65a3cb460e8d6dee6e7ea4f04c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:10.370664 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:10.370949 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:10.371226 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:10.381261 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:10.382891 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:10.392449 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1449/2896] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:36:10.795822 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:10.797347 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:10.811904 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645c22e-c4b8-41c4-b777-e41d8523ff0b None None] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:10.816837 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:10.825111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:10.825111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:10.825111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] PATH_INFO: `/v3/projects/8e5d25e7f10e496c84da9c18c9a0713e` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:10.825111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5d25e7f10e496c84da9c18c9a0713e)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:10.825111 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:10.937346 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5d25e7f10e496c84da9c18c9a0713e', 'request_id': 'req-8f8e47e3-91ad-4c4a-b379-52bba2aea936'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.003931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5d25e7f10e496c84da9c18c9a0713e', 'request_id': 'req-8f8e47e3-91ad-4c4a-b379-52bba2aea936'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.010616 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5d25e7f10e496c84da9c18c9a0713e', 'request_id': 'req-8f8e47e3-91ad-4c4a-b379-52bba2aea936'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.022001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] The token cache is being invalidate because project 8e5d25e7f10e496c84da9c18c9a0713e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:11.022303 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.022958 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.024559 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1448/2897] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:10 2022] DELETE /identity/v3/projects/8e5d25e7f10e496c84da9c18c9a0713e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:11.028711 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:11.039400 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff61caa-3c1e-40f2-b7aa-a50007a778d0 service neutron] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:11.098349 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:11.099725 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:11.100098 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:11.100383 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] PATH_INFO: `/v3/users/a8ef77f4779c4a83a515945427027964` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:11.101653 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ef77f4779c4a83a515945427027964)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:11.108001 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:11.556780 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ef77f4779c4a83a515945427027964'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.566997 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:11.569423 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ef77f4779c4a83a515945427027964'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.576328 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ef77f4779c4a83a515945427027964'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.577090 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ef77f4779c4a83a515945427027964'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.577685 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ef77f4779c4a83a515945427027964'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:11.680933 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1450/2898] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:11 2022] DELETE /identity/v3/users/a8ef77f4779c4a83a515945427027964 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:12.088001 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:12.089468 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:12.103219 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e47e3-91ad-4c4a-b379-52bba2aea936 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:12.162329 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:12.163218 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:12.163507 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:12.163786 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] PATH_INFO: `/v3/projects/6f3c6682c5e0465a9dd05e92102e9795` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:12.164999 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3c6682c5e0465a9dd05e92102e9795)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:12.167034 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:12.314073 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3c6682c5e0465a9dd05e92102e9795', 'request_id': 'req-10154c59-0509-4b99-bd5a-697504a29383'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.393900 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3c6682c5e0465a9dd05e92102e9795', 'request_id': 'req-10154c59-0509-4b99-bd5a-697504a29383'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.400108 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3c6682c5e0465a9dd05e92102e9795', 'request_id': 'req-10154c59-0509-4b99-bd5a-697504a29383'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.401181 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:12.412333 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] The token cache is being invalidate because project 6f3c6682c5e0465a9dd05e92102e9795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:12.412720 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.413444 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.415213 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1449/2899] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:12 2022] DELETE /identity/v3/projects/6f3c6682c5e0465a9dd05e92102e9795 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:12.419154 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:12.420615 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:12.434744 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71369cb1-cd0e-40fe-be5c-e4697e4c1666 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:12.490678 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:12.491554 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:12.491844 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:12.492124 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] PATH_INFO: `/v3/users/71fd85d3ddc64195bb501f0a39df32c6` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:12.493340 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fd85d3ddc64195bb501f0a39df32c6)` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:12.495348 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:12.670841 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fd85d3ddc64195bb501f0a39df32c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.682818 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fd85d3ddc64195bb501f0a39df32c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.689720 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fd85d3ddc64195bb501f0a39df32c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.690430 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fd85d3ddc64195bb501f0a39df32c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.691037 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.notifications [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fd85d3ddc64195bb501f0a39df32c6'} {{(pid=80466) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:12.788877 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1451/2900] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jun 20 12:36:12 2022] DELETE /identity/v3/users/71fd85d3ddc64195bb501f0a39df32c6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:13.241274 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Authenticating user token {{(pid=80465) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:36:13.242804 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.fernet_utils [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80465) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:36:13.257314 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10154c59-0509-4b99-bd5a-697504a29383 admin admin] Validating token access rules against request {{(pid=80465) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:36:13.315753 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c92fa328437c4093a3eddeda8c856c28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f7b8b3cd4a74f7eb74d84f735aad86f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80465) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:36:13.316646 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:36:13.316931 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:36:13.317211 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] PATH_INFO: `/v3/projects/06fcb71d71b84b68bca1291d514e7b3a` {{(pid=80465) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:36:13.318967 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06fcb71d71b84b68bca1291d514e7b3a)` {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:36:13.320905 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] RBAC: Authorization granted {{(pid=80465) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:36:13.422076 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06fcb71d71b84b68bca1291d514e7b3a', 'request_id': 'req-44527031-a804-4872-8ca4-3d4e75124bc0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:13.508361 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06fcb71d71b84b68bca1291d514e7b3a', 'request_id': 'req-44527031-a804-4872-8ca4-3d4e75124bc0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:13.514348 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06fcb71d71b84b68bca1291d514e7b3a', 'request_id': 'req-44527031-a804-4872-8ca4-3d4e75124bc0'} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:13.526399 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] The token cache is being invalidate because project 06fcb71d71b84b68bca1291d514e7b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80465) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 12:36:13.526691 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:13.527324 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG keystone.notifications [None req-44527031-a804-4872-8ca4-3d4e75124bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80465) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 12:36:13.528892 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: [pid: 80465|app: 0|req: 1450/2901] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jun 20 12:36:13 2022] DELETE /identity/v3/projects/06fcb71d71b84b68bca1291d514e7b3a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 12:36:22.784903 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:DELETE=12,keystone:SELECT=60,keystone:INSERT=2 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:36:23.523358 dv-cinder-836973-4-iscsi devstack@keystone.service[80465]: DEBUG dbcounter [-] [80465] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80465) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 12:41:14.239000 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Authenticating user token {{(pid=80466) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 12:41:14.240472 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:14.309284 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eee563-765e-4793-b10a-27f33d13dbb3 admin admin] Validating token access rules against request {{(pid=80466) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 12:41:14.368065 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd290657114cf4e8992cba9c10a6c7713', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16580044a8334c4f927c120eeed3ce09', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80466) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 12:41:14.368640 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] REQUEST_METHOD: `GET` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 12:41:14.368924 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] SCRIPT_NAME: `/identity` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 12:41:14.369203 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80466) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 12:41:14.370969 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.fernet_utils [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80466) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 12:41:14.382662 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 12:41:14.384252 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590181b-6901-4c8e-9c5f-9bc4ad3d432a service placement] RBAC: Authorization granted {{(pid=80466) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 12:41:14.394746 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: [pid: 80466|app: 0|req: 1452/2902] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jun 20 12:41:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 12:41:24.390551 dv-cinder-836973-4-iscsi devstack@keystone.service[80466]: DEBUG dbcounter [-] [80466] Writing DB stats keystone:SELECT=58 {{(pid=80466) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}